2026-03-27 21:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 21:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 21:45:05 [ayvens.de] INFO: Starting spider ayvens.de
2026-03-27 21:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 21:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 21:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 21:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 21:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: bdafecbaff95b185
2026-03-27 21:45:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 21:45:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.de/task_43_2026-03-27T21_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 21:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 21:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 21:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 21:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 21:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 21:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 21:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-27 21:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-27 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-27 21:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 21:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 21:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 21:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 21:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 21:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 21:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 21:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 21:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 21:45:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-27 21:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-27 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-27 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 21:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [ayvens.de] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'i6fUaJWPXPCbhMt7/C3wZn|2026-03-27T21:45:16.680Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806183916, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'hm+1RaJ+COHa1oXapZXhe8|1774647918106|1774647918106', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774649718, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-27 21:45:18 [ayvens.de] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'i6fUaJWPXPCbhMt7/C3wZn|2026-03-27T21:45:16.680Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'hm+1RaJ+COHa1oXapZXhe8|1774647918106|1774647918106', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-27 21:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-27 21:45:18 [ayvens.de] INFO: Intercepting token...
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-27 21:45:18 [ayvens.de] INFO: Scrolling element to trigger lazy load...
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:18 [ayvens.de] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-27 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-27 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-27 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 21:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-27 21:45:20 [ayvens.de] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-27 21:45:20 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-27 21:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 21:45:23 [ayvens.de] INFO: Found listing with ID: 1987779
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987779%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [ayvens.de] INFO: Scrape type for 1987779: 1
2026-03-27 21:45:23 [ayvens.de] INFO: Extracting data for car ID: 1987779
2026-03-27 21:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-27 21:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33ffe25-53ed-5144-837e-f7bdbecc4a33 with scrape type 1
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/1.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/2.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/3.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/4.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/5.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/6.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/7.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/8.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/9.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/10.jpg not downloaded yet
2026-03-27 21:45:23 [ayvens.de] INFO: Found listing with ID: 1987780
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987780%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [ayvens.de] INFO: Scrape type for 1987780: 1
2026-03-27 21:45:23 [ayvens.de] INFO: Extracting data for car ID: 1987780
2026-03-27 21:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-27 21:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with scrape type 1
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/1.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/2.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/3.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/4.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/5.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/6.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/7.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/8.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/9.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/10.jpg not downloaded yet
2026-03-27 21:45:23 [ayvens.de] INFO: Found listing with ID: 1987781
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987781%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [ayvens.de] INFO: Scrape type for 1987781: 1
2026-03-27 21:45:23 [ayvens.de] INFO: Extracting data for car ID: 1987781
2026-03-27 21:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-27 21:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/1.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/2.jpg not downloaded yet
2026-03-27 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/3.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/4.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/5.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/6.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/7.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/8.jpg not downloaded yet
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/9.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/10.jpg not downloaded yet
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [ayvens.de] INFO: Found listing with ID: 1987782
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987782%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [ayvens.de] INFO: Scrape type for 1987782: 1
2026-03-27 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1987782
2026-03-27 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-27 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/1.jpg not downloaded yet
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/2.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/3.jpg not downloaded yet
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51eba10>
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/4.jpg saved to cache
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/4.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/5.jpg not downloaded yet
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/6.jpg not downloaded yet
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f75d0>
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/3.jpg saved to cache
2026-03-27 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ad9f90>
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/1.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3050>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/5.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6abba50>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/2.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b14c90>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/7.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/7.jpg not downloaded yet
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/8.jpg not downloaded yet
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/9.jpg not downloaded yet
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/10.jpg not downloaded yet
2026-03-27 21:45:25 [ayvens.de] INFO: Found listing with ID: 1987783
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987783%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [ayvens.de] INFO: Scrape type for 1987783: 1
2026-03-27 21:45:25 [ayvens.de] INFO: Extracting data for car ID: 1987783
2026-03-27 21:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-27 21:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with scrape type 1
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/1.jpg not downloaded yet
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/2.jpg not downloaded yet
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ea390>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/6.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522f210>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/1.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69699d0>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/8.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/3.jpg not downloaded yet
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6989a90>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/3.jpg saved to cache
2026-03-27 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51e93d0>
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/4.jpg saved to cache
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b30110>
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/10.jpg saved to cache
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee697ba10>
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fcf82f0410bd54c58a24730b64428b523%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/9.jpg saved to cache
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b33ffe25-53ed-5144-837e-f7bdbecc4a33
2026-03-27 21:45:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b33ffe25-53ed-5144-837e-f7bdbecc4a33, skipping ID generation
2026-03-27 21:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33ffe25-53ed-5144-837e-f7bdbecc4a33 with scrape type 1
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b33ffe25-53ed-5144-837e-f7bdbecc4a33 sending to next pipeline
2026-03-27 21:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b33ffe25-53ed-5144-837e-f7bdbecc4a33, identifier: 1987779
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee882cf50>
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/2.jpg saved to cache
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/4.jpg not downloaded yet
2026-03-27 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-27 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779
2026-03-27 21:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b33ffe25-53ed-5144-837e-f7bdbecc4a33 with identifier: 1987779 to the API
2026-03-27 21:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b33ffe25-53ed-5144-837e-f7bdbecc4a33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 45816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33ffe25-53ed-5144-837e-f7bdbecc4a33/b33ffe25-53ed-5144-837e-f7bdbecc4a33_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/cf82f0410bd54c58a24730b64428b523/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 INTENS Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 INTENS Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987779%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [ayvens.de] INFO: Saving data for 1987779: {'created_time': 1774647927.223909, 'last_price_update_time': 1774647927.223921, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987779') HTTP/1.1" 204 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/5.jpg not downloaded yet
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/6.jpg not downloaded yet
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/7.jpg not downloaded yet
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/8.jpg not downloaded yet
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/9.jpg not downloaded yet
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/10.jpg not downloaded yet
2026-03-27 21:45:27 [ayvens.de] INFO: Found listing with ID: 1987784
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987784%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [ayvens.de] INFO: Scrape type for 1987784: 1
2026-03-27 21:45:27 [ayvens.de] INFO: Extracting data for car ID: 1987784
2026-03-27 21:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-27 21:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/1.jpg not downloaded yet
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/2.jpg not downloaded yet
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8906f50>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/5.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51e9350>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/10.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/3.jpg not downloaded yet
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aab090>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/7.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfae50>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/5.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd2c50>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/6.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6df9a10>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/8.jpg saved to cache
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/4.jpg not downloaded yet
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/5.jpg not downloaded yet
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9d590>
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/9.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a25750>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/6.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/6.jpg not downloaded yet
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/7.jpg not downloaded yet
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/8.jpg not downloaded yet
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/9.jpg not downloaded yet
2026-03-27 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/10.jpg not downloaded yet
2026-03-27 21:45:28 [ayvens.de] INFO: Found listing with ID: 1987785
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987785%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [ayvens.de] INFO: Scrape type for 1987785: 1
2026-03-27 21:45:28 [ayvens.de] INFO: Extracting data for car ID: 1987785
2026-03-27 21:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-27 21:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/1.jpg not downloaded yet
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/2.jpg not downloaded yet
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b16210>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/7.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53590d0>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/5.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/3.jpg not downloaded yet
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5351b90>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/3.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b96fd0>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/6.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5229cd0>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/9.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5232290>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/10.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648bf50>
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/2.jpg saved to cache
2026-03-27 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/4.jpg not downloaded yet
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/5.jpg not downloaded yet
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab3a50>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/1.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/6.jpg not downloaded yet
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/7.jpg not downloaded yet
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/8.jpg not downloaded yet
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/9.jpg not downloaded yet
2026-03-27 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/10.jpg not downloaded yet
2026-03-27 21:45:29 [ayvens.de] INFO: Found listing with ID: 1987786
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987786%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [ayvens.de] INFO: Scrape type for 1987786: 1
2026-03-27 21:45:29 [ayvens.de] INFO: Extracting data for car ID: 1987786
2026-03-27 21:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-27 21:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 1
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/1.jpg not downloaded yet
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/2.jpg not downloaded yet
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab24d0>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/8.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/3.jpg not downloaded yet
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bf0710>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/6.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52117d0>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/2.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69805d0>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/5.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a9750>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/10.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5212510>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/1.jpg saved to cache
2026-03-27 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53153d0>
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/3.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/4.jpg not downloaded yet
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/5.jpg not downloaded yet
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a90110>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/4.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/6.jpg not downloaded yet
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/7.jpg not downloaded yet
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/8.jpg not downloaded yet
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/9.jpg not downloaded yet
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/ab6727681f8c4e1bac1ec46da529009f/images/large/10.jpg not downloaded yet
2026-03-27 21:45:30 [ayvens.de] INFO: Found listing with ID: 1987787
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987787%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [ayvens.de] INFO: Scrape type for 1987787: 1
2026-03-27 21:45:30 [ayvens.de] INFO: Extracting data for car ID: 1987787
2026-03-27 21:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-27 21:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 1
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/1.jpg not downloaded yet
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/2.jpg not downloaded yet
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536f650>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/1.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/3.jpg not downloaded yet
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b133d0>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/10.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c5a50>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/4.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ebf50>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/6.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d62bd0>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/3.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d6e50>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/2.jpg saved to cache
2026-03-27 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e8710>
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/7.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d45d50>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/9.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/4.jpg not downloaded yet
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/5.jpg not downloaded yet
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/6.jpg not downloaded yet
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/7.jpg not downloaded yet
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/8.jpg not downloaded yet
2026-03-27 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/9.jpg not downloaded yet
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/10.jpg not downloaded yet
2026-03-27 21:45:31 [ayvens.de] INFO: Found listing with ID: 1987788
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987788%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [ayvens.de] INFO: Scrape type for 1987788: 1
2026-03-27 21:45:31 [ayvens.de] INFO: Extracting data for car ID: 1987788
2026-03-27 21:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-27 21:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with scrape type 1
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/1.jpg not downloaded yet
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2f310>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/7.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/2.jpg not downloaded yet
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee530a750>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/6.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8843590>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/5.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6982a90>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/4.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/3.jpg not downloaded yet
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52f8350>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/10.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1c9d0>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/1.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69715d0>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/2.jpg saved to cache
2026-03-27 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee883eed0>
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/3.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/4.jpg not downloaded yet
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/5.jpg not downloaded yet
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/6.jpg not downloaded yet
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/7.jpg not downloaded yet
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/8.jpg not downloaded yet
2026-03-27 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/9.jpg not downloaded yet
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/10.jpg not downloaded yet
2026-03-27 21:45:32 [ayvens.de] INFO: Found listing with ID: 1987789
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987789%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [ayvens.de] INFO: Scrape type for 1987789: 1
2026-03-27 21:45:32 [ayvens.de] INFO: Extracting data for car ID: 1987789
2026-03-27 21:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-27 21:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with scrape type 1
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/1.jpg not downloaded yet
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/2.jpg not downloaded yet
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1e250>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/9.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d1610>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/6.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6982e90>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/5.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d1d50>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/4.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8842590>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/7.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/3.jpg not downloaded yet
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8a3da90>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/8.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3510>
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F1f5a1a3d2d6441af807ac83938dc8243%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/8.jpg saved to cache
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-27 21:45:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6209d459-4198-5691-9aab-360956f8f4d6, skipping ID generation
2026-03-27 21:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-27 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6209d459-4198-5691-9aab-360956f8f4d6 sending to next pipeline
2026-03-27 21:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6209d459-4198-5691-9aab-360956f8f4d6, identifier: 1987785
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/4.jpg not downloaded yet
2026-03-27 21:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-27 21:45:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785
2026-03-27 21:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1987785 to the API
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '6209d459-4198-5691-9aab-360956f8f4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Vito / Marco Polo',
 'odometer': 107057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/1f5a1a3d2d6441af807ac83938dc8243/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Vito / Marco Polo MERCEDES-BENZ Vito 114 CDI Lang HA '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ Vito 114 CDI Lang HA Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987785%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [ayvens.de] INFO: Saving data for 1987785: {'created_time': 1774647933.530477, 'last_price_update_time': 1774647933.530496, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987785') HTTP/1.1" 204 0
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/5.jpg not downloaded yet
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536bb50>
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/3.jpg saved to cache
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/6.jpg not downloaded yet
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/7.jpg not downloaded yet
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/8.jpg not downloaded yet
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/9.jpg not downloaded yet
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/10.jpg not downloaded yet
2026-03-27 21:45:33 [ayvens.de] INFO: Found listing with ID: 1987790
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987790%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [ayvens.de] INFO: Scrape type for 1987790: 1
2026-03-27 21:45:33 [ayvens.de] INFO: Extracting data for car ID: 1987790
2026-03-27 21:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-27 21:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc40d71-74f4-5f23-bae5-672a480991f4 with scrape type 1
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/1.jpg not downloaded yet
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/2.jpg not downloaded yet
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa8750>
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/2.jpg saved to cache
2026-03-27 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d53fd0>
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/6.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5233310>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/1.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/3.jpg not downloaded yet
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e7c850>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/1.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5378a10>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/10.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/4.jpg not downloaded yet
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/5.jpg not downloaded yet
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5322c90>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/5.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd2dd0>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/2.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aba750>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/9.jpg saved to cache
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/6.jpg not downloaded yet
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/7.jpg not downloaded yet
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/8.jpg not downloaded yet
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/9.jpg not downloaded yet
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/10.jpg not downloaded yet
2026-03-27 21:45:34 [ayvens.de] INFO: Found listing with ID: 1987791
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987791%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [ayvens.de] INFO: Scrape type for 1987791: 1
2026-03-27 21:45:34 [ayvens.de] INFO: Extracting data for car ID: 1987791
2026-03-27 21:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-27 21:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29b5c194-188c-50fc-9a0d-643cdcecce33 with scrape type 1
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/1.jpg not downloaded yet
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/2.jpg not downloaded yet
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd3290>
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/5.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac12d0>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/4.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698b950>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/6.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f00190>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/8.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69895d0>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/3.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6989650>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F66833e3f4c284813bacde06df99fb19a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/7.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-27 21:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18ff01f4-8956-544e-ada0-27e1ec8ed875, skipping ID generation
2026-03-27 21:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 1
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 sending to next pipeline
2026-03-27 21:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 18ff01f4-8956-544e-ada0-27e1ec8ed875, identifier: 1987787
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5369010>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/2.jpg saved to cache
2026-03-27 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a25710>
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/3.jpg saved to cache
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/3.jpg not downloaded yet
2026-03-27 21:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-27 21:45:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787
2026-03-27 21:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1987787 to the API
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '18ff01f4-8956-544e-ada0-27e1ec8ed875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 126506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/66833e3f4c284813bacde06df99fb19a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987787%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [ayvens.de] INFO: Saving data for 1987787: {'created_time': 1774647936.401469, 'last_price_update_time': 1774647936.401481, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987787') HTTP/1.1" 204 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/4.jpg not downloaded yet
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/5.jpg not downloaded yet
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/6.jpg not downloaded yet
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/7.jpg not downloaded yet
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/8.jpg not downloaded yet
2026-03-27 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/9.jpg not downloaded yet
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/10.jpg not downloaded yet
2026-03-27 21:45:36 [ayvens.de] INFO: Found listing with ID: 1987792
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987792%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [ayvens.de] INFO: Scrape type for 1987792: 1
2026-03-27 21:45:36 [ayvens.de] INFO: Extracting data for car ID: 1987792
2026-03-27 21:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-27 21:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c482979-bb1e-5dac-9b73-7dcb854faea9 with scrape type 1
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/1.jpg not downloaded yet
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/2.jpg not downloaded yet
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee530a750>
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/10.jpg saved to cache
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab0290>
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/4.jpg saved to cache
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1e350>
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/2.jpg saved to cache
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/3.jpg not downloaded yet
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b13510>
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/5.jpg saved to cache
2026-03-27 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64997d0>
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/6.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a3b90>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/3.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee649a290>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/1.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/4.jpg not downloaded yet
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/5.jpg not downloaded yet
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bca90>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/1.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/6.jpg not downloaded yet
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/7.jpg not downloaded yet
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/8.jpg not downloaded yet
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/9.jpg not downloaded yet
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/10.jpg not downloaded yet
2026-03-27 21:45:37 [ayvens.de] INFO: Found listing with ID: 1987793
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987793%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [ayvens.de] INFO: Scrape type for 1987793: 1
2026-03-27 21:45:37 [ayvens.de] INFO: Extracting data for car ID: 1987793
2026-03-27 21:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-27 21:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with scrape type 1
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/1.jpg not downloaded yet
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/2.jpg not downloaded yet
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/3.jpg not downloaded yet
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f1ad0>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/4.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5353390>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/10.jpg saved to cache
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/4.jpg not downloaded yet
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee537af10>
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/1.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf8410>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/3.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64937d0>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/6.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6971a10>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/2.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6acd350>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/7.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cfa490>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/5.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/5.jpg not downloaded yet
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/6.jpg not downloaded yet
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/7.jpg not downloaded yet
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/8.jpg not downloaded yet
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/9.jpg not downloaded yet
2026-03-27 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/10.jpg not downloaded yet
2026-03-27 21:45:38 [ayvens.de] INFO: Found listing with ID: 1987794
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987794%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [ayvens.de] INFO: Scrape type for 1987794: 1
2026-03-27 21:45:38 [ayvens.de] INFO: Extracting data for car ID: 1987794
2026-03-27 21:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-27 21:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with scrape type 1
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/1.jpg not downloaded yet
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/2.jpg not downloaded yet
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6973f90>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/3.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f00c50>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/1.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ca5210>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/4.jpg saved to cache
2026-03-27 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed38d0>
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/2.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eeb750>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/6.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2550>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/9.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ee9c10>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/10.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d63390>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/5.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/3.jpg not downloaded yet
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/4.jpg not downloaded yet
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/5.jpg not downloaded yet
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/6.jpg not downloaded yet
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/7.jpg not downloaded yet
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/8.jpg not downloaded yet
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/9.jpg not downloaded yet
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/10.jpg not downloaded yet
2026-03-27 21:45:39 [ayvens.de] INFO: Found listing with ID: 1987795
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987795%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [ayvens.de] INFO: Scrape type for 1987795: 1
2026-03-27 21:45:39 [ayvens.de] INFO: Extracting data for car ID: 1987795
2026-03-27 21:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-27 21:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b932a82-f05b-5690-a011-893c32e01134 with scrape type 1
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/1.jpg not downloaded yet
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/2.jpg not downloaded yet
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c5bd10>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/7.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/3.jpg not downloaded yet
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5367250>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/6.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6af4e50>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/5.jpg saved to cache
2026-03-27 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6af6c50>
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/4.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab2750>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/8.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/4.jpg not downloaded yet
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/5.jpg not downloaded yet
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d3450>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/2.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b327d0>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/3.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e8410>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/4.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/6.jpg not downloaded yet
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/7.jpg not downloaded yet
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/8.jpg not downloaded yet
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/9.jpg not downloaded yet
2026-03-27 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/10.jpg not downloaded yet
2026-03-27 21:45:40 [ayvens.de] INFO: Found listing with ID: 1987796
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987796%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [ayvens.de] INFO: Scrape type for 1987796: 1
2026-03-27 21:45:40 [ayvens.de] INFO: Extracting data for car ID: 1987796
2026-03-27 21:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-27 21:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 1
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/1.jpg not downloaded yet
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/2.jpg not downloaded yet
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9ee50>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/6.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/3.jpg not downloaded yet
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee649a750>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/10.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d52150>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/2.jpg saved to cache
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/4.jpg not downloaded yet
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/5.jpg not downloaded yet
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b6410>
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/5.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e36f10>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/7.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b13110>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/1.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf9490>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/3.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d3010>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/1.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/6.jpg not downloaded yet
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/7.jpg not downloaded yet
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/8.jpg not downloaded yet
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/9.jpg not downloaded yet
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/10.jpg not downloaded yet
2026-03-27 21:45:41 [ayvens.de] INFO: Found listing with ID: 1987797
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987797%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [ayvens.de] INFO: Scrape type for 1987797: 1
2026-03-27 21:45:41 [ayvens.de] INFO: Extracting data for car ID: 1987797
2026-03-27 21:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-27 21:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 1
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/1.jpg not downloaded yet
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/2.jpg not downloaded yet
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c54d0>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/6.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/3.jpg not downloaded yet
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c6f50>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/4.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6af57d0>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/7.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ff810>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/10.jpg saved to cache
2026-03-27 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6af7fd0>
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/3.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7df50>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/2.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/4.jpg not downloaded yet
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/5.jpg not downloaded yet
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5367fd0>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/5.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ae5f10>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/4.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/6.jpg not downloaded yet
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/7.jpg not downloaded yet
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8cd50>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/6.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/8.jpg not downloaded yet
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/9.jpg not downloaded yet
2026-03-27 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/10.jpg not downloaded yet
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2bd0>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/7.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [ayvens.de] INFO: Found listing with ID: 1987798
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987798%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [ayvens.de] INFO: Scrape type for 1987798: 1
2026-03-27 21:45:42 [ayvens.de] INFO: Extracting data for car ID: 1987798
2026-03-27 21:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-27 21:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 1
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/1.jpg not downloaded yet
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/2.jpg not downloaded yet
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6daaa50>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/1.jpg saved to cache
2026-03-27 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c5510>
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/5.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5350d10>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/10.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d7410>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/9.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f4d50>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/3.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69aa990>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/4.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/3.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/4.jpg not downloaded yet
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/5.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/6.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/7.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/8.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/9.jpg not downloaded yet
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522fa90>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/5.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/10.jpg not downloaded yet
2026-03-27 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:43 [ayvens.de] INFO: Found listing with ID: 1987799
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987799%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [ayvens.de] INFO: Scrape type for 1987799: 1
2026-03-27 21:45:43 [ayvens.de] INFO: Extracting data for car ID: 1987799
2026-03-27 21:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-27 21:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acad9b67-2e5f-5e43-a57e-f3735af501a4 with scrape type 1
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/1.jpg not downloaded yet
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/2.jpg not downloaded yet
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa90d0>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/4.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f3590>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/2.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a06dd0>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/10.jpg saved to cache
2026-03-27 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c20550>
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/7.jpg saved to cache
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a07bd0>
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/6.jpg saved to cache
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa8cd0>
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/3.jpg saved to cache
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69aa750>
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/1.jpg saved to cache
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/3.jpg not downloaded yet
2026-03-27 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/4.jpg not downloaded yet
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6490110>
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/2.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/5.jpg not downloaded yet
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/6.jpg not downloaded yet
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/7.jpg not downloaded yet
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed0150>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/8.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/8.jpg not downloaded yet
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bf0bd0>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/5.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520d850>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/6.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b4cd0>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/1.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/9.jpg not downloaded yet
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b31b50>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/7.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523ca50>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/10.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa0190>
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/10.jpg saved to cache
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/10.jpg not downloaded yet
2026-03-27 21:45:45 [ayvens.de] INFO: Found listing with ID: 1987800
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987800%27 HTTP/1.1" 200 None
2026-03-27 21:45:45 [ayvens.de] INFO: Scrape type for 1987800: 1
2026-03-27 21:45:45 [ayvens.de] INFO: Extracting data for car ID: 1987800
2026-03-27 21:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-27 21:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b721d2-b05a-57f4-83b8-c11a53a63f77 with scrape type 1
2026-03-27 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/1.jpg not downloaded yet
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52421d0>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/3.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/2.jpg not downloaded yet
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/3.jpg not downloaded yet
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/4.jpg not downloaded yet
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/5.jpg not downloaded yet
2026-03-27 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/6.jpg not downloaded yet
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/7.jpg not downloaded yet
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d51090>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/5.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/8.jpg not downloaded yet
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/9.jpg not downloaded yet
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/10.jpg not downloaded yet
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d2dd0>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/4.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f7d50>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/2.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb3a50>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/2.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69eb190>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/10.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2d10>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/6.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f68d0>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/1.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb0f50>
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/9.jpg saved to cache
2026-03-27 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:46 [ayvens.de] INFO: Found listing with ID: 1987801
2026-03-27 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987801%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [ayvens.de] INFO: Scrape type for 1987801: 1
2026-03-27 21:45:47 [ayvens.de] INFO: Extracting data for car ID: 1987801
2026-03-27 21:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-27 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8024555-6b9c-542b-8625-3da326403b1a with scrape type 1
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/1.jpg not downloaded yet
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/2.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/3.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/4.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/5.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/6.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/7.jpg not downloaded yet
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/8.jpg not downloaded yet
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/9.jpg not downloaded yet
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b95550>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/8.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532d250>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/8.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%C3%BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fü-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/10.jpg not downloaded yet
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b17590>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/4.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:47 [ayvens.de] INFO: Found listing with ID: 1987802
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987802%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [ayvens.de] INFO: Scrape type for 1987802: 1
2026-03-27 21:45:47 [ayvens.de] INFO: Extracting data for car ID: 1987802
2026-03-27 21:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-27 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11edacd-abea-5948-aafb-0743e15f910b with scrape type 1
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/1.jpg not downloaded yet
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/2.jpg not downloaded yet
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bdad0>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/7.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a0390>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/3.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1fa90>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/9.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314a10>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/5.jpg saved to cache
2026-03-27 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e8cd0>
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252Fd94ebd1696524fb694fe540f1b652828%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/1.jpg saved to cache
2026-03-27 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-27 21:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be174198-dc82-584e-96c3-b82d1b969eee, skipping ID generation
2026-03-27 21:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 1
2026-03-27 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be174198-dc82-584e-96c3-b82d1b969eee sending to next pipeline
2026-03-27 21:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: be174198-dc82-584e-96c3-b82d1b969eee, identifier: 1987798
2026-03-27 21:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-27 21:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798
2026-03-27 21:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1987798 to the API
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'be174198-dc82-584e-96c3-b82d1b969eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 70856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/d94ebd1696524fb694fe540f1b652828/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X Kombi, '
         '5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987798%27 HTTP/1.1" 200 None
2026-03-27 21:45:48 [ayvens.de] INFO: Saving data for 1987798: {'created_time': 1774647948.82813, 'last_price_update_time': 1774647948.828141, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987798') HTTP/1.1" 204 0
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/3.jpg not downloaded yet
2026-03-27 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/4.jpg not downloaded yet
2026-03-27 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d4f90>
2026-03-27 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/2.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ae7450>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/10.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/5.jpg not downloaded yet
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/6.jpg not downloaded yet
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d56390>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/1.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/7.jpg not downloaded yet
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/8.jpg not downloaded yet
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed3250>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/9.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5372950>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/8.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac0b10>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/7.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcef61eeb10>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/10.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/9.jpg not downloaded yet
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/10.jpg not downloaded yet
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:49 [ayvens.de] INFO: Found listing with ID: 1987803
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987803%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [ayvens.de] INFO: Scrape type for 1987803: 1
2026-03-27 21:45:49 [ayvens.de] INFO: Extracting data for car ID: 1987803
2026-03-27 21:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-27 21:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with scrape type 1
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/1.jpg not downloaded yet
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5373190>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/7.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d57510>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/1.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d2dd0>
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/2.jpg saved to cache
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/2.jpg not downloaded yet
2026-03-27 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/3.jpg not downloaded yet
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8842390>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/6.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/4.jpg not downloaded yet
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/5.jpg not downloaded yet
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/6.jpg not downloaded yet
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8db90>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/3.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/7.jpg not downloaded yet
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/8.jpg not downloaded yet
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6da9c90>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/10.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5348710>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/8.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c77a90>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/9.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536cb10>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/7.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/9.jpg not downloaded yet
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/10.jpg not downloaded yet
2026-03-27 21:45:50 [ayvens.de] INFO: Found listing with ID: 1987804
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987804%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [ayvens.de] INFO: Scrape type for 1987804: 1
2026-03-27 21:45:50 [ayvens.de] INFO: Extracting data for car ID: 1987804
2026-03-27 21:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-27 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with scrape type 1
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/1.jpg not downloaded yet
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6981690>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/2.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52fb910>
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/1.jpg saved to cache
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/2.jpg not downloaded yet
2026-03-27 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/3.jpg not downloaded yet
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53517d0>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/6.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/4.jpg not downloaded yet
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/5.jpg not downloaded yet
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/6.jpg not downloaded yet
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52f3050>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/6.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eeaa10>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/4.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/7.jpg not downloaded yet
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/8.jpg not downloaded yet
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee699b2d0>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/7.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532dcd0>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/5.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f1f90>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff%25C3%25BC-%252F9d1b57244ec345cfb3b6dff6ac1bf8d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/4.jpg saved to cache
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8024555-6b9c-542b-8625-3da326403b1a
2026-03-27 21:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8024555-6b9c-542b-8625-3da326403b1a, skipping ID generation
2026-03-27 21:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8024555-6b9c-542b-8625-3da326403b1a with scrape type 1
2026-03-27 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8024555-6b9c-542b-8625-3da326403b1a sending to next pipeline
2026-03-27 21:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f8024555-6b9c-542b-8625-3da326403b1a, identifier: 1987801
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee882cf50>
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/5.jpg saved to cache
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9c3d0>
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/3.jpg saved to cache
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/9.jpg not downloaded yet
2026-03-27 21:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-27 21:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801
2026-03-27 21:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f8024555-6b9c-542b-8625-3da326403b1a with identifier: 1987801 to the API
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f8024555-6b9c-542b-8625-3da326403b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 40431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8024555-6b9c-542b-8625-3da326403b1a/f8024555-6b9c-542b-8625-3da326403b1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f%C3%BC-/9d1b57244ec345cfb3b6dff6ac1bf8d1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987801%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [ayvens.de] INFO: Saving data for 1987801: {'created_time': 1774647952.468924, 'last_price_update_time': 1774647952.468937, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987801') HTTP/1.1" 204 0
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/10.jpg not downloaded yet
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [ayvens.de] INFO: Found listing with ID: 1987805
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987805%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [ayvens.de] INFO: Scrape type for 1987805: 1
2026-03-27 21:45:52 [ayvens.de] INFO: Extracting data for car ID: 1987805
2026-03-27 21:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-27 21:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157ef602-4c35-5024-9168-76ec41d79bc9 with scrape type 1
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/1.jpg not downloaded yet
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6491450>
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/10.jpg saved to cache
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/2.jpg not downloaded yet
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/3.jpg not downloaded yet
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6978910>
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/1.jpg saved to cache
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8f290>
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/8.jpg saved to cache
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/4.jpg not downloaded yet
2026-03-27 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/5.jpg not downloaded yet
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/6.jpg not downloaded yet
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0d350>
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/2.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b2b650>
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/6.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b65010>
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/5.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6980a90>
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/3.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/7.jpg not downloaded yet
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/8.jpg not downloaded yet
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d462d0>
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-l%252F89d5581fb102412aa25d403e2d5d5585%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/9.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b11edacd-abea-5948-aafb-0743e15f910b
2026-03-27 21:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b11edacd-abea-5948-aafb-0743e15f910b, skipping ID generation
2026-03-27 21:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11edacd-abea-5948-aafb-0743e15f910b with scrape type 1
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b11edacd-abea-5948-aafb-0743e15f910b sending to next pipeline
2026-03-27 21:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b11edacd-abea-5948-aafb-0743e15f910b, identifier: 1987802
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8557150>
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/8.jpg saved to cache
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/9.jpg not downloaded yet
2026-03-27 21:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-27 21:45:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802
2026-03-27 21:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b11edacd-abea-5948-aafb-0743e15f910b with identifier: 1987802 to the API
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Absolute Black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b11edacd-abea-5948-aafb-0743e15f910b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 21210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11edacd-abea-5948-aafb-0743e15f910b/b11edacd-abea-5948-aafb-0743e15f910b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-l/89d5581fb102412aa25d403e2d5d5585/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E PREMIUM Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E PREMIUM Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987802%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [ayvens.de] INFO: Saving data for 1987802: {'created_time': 1774647954.017982, 'last_price_update_time': 1774647954.017993, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987802') HTTP/1.1" 204 0
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/10.jpg not downloaded yet
2026-03-27 21:45:54 [ayvens.de] INFO: Found listing with ID: 1987806
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987806%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [ayvens.de] INFO: Scrape type for 1987806: 1
2026-03-27 21:45:54 [ayvens.de] INFO: Extracting data for car ID: 1987806
2026-03-27 21:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-27 21:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6a67e7-7153-55d9-9602-e1b985887e85 with scrape type 1
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/1.jpg not downloaded yet
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b31cd0>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/3.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/2.jpg not downloaded yet
2026-03-27 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/3.jpg not downloaded yet
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8840fd0>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/10.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/4.jpg not downloaded yet
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/5.jpg not downloaded yet
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/6.jpg not downloaded yet
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ace090>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/1.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7c4d0>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/7.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee9fcd650>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/4.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a25310>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/6.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d73f10>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/9.jpg saved to cache
2026-03-27 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7ebd0>
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/2.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/7.jpg not downloaded yet
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/8.jpg not downloaded yet
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/9.jpg not downloaded yet
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/10.jpg not downloaded yet
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [ayvens.de] INFO: Found listing with ID: 1987807
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987807%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [ayvens.de] INFO: Scrape type for 1987807: 1
2026-03-27 21:45:55 [ayvens.de] INFO: Extracting data for car ID: 1987807
2026-03-27 21:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-27 21:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3827ca3-94ec-5f3f-996b-9f5971f76112 with scrape type 1
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/1.jpg not downloaded yet
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/2.jpg not downloaded yet
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/3.jpg not downloaded yet
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/4.jpg not downloaded yet
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b43d0>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/10.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ae59d0>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/9.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/5.jpg not downloaded yet
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b94590>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/4.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b4d50>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/7.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed3b50>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/3.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/6.jpg not downloaded yet
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/7.jpg not downloaded yet
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522f490>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/2.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d4510>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/8.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69717d0>
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/1.jpg saved to cache
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/8.jpg not downloaded yet
2026-03-27 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/9.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/10.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [ayvens.de] INFO: Found listing with ID: 1987808
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987808%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [ayvens.de] INFO: Scrape type for 1987808: 1
2026-03-27 21:45:56 [ayvens.de] INFO: Extracting data for car ID: 1987808
2026-03-27 21:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-27 21:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a92b7d-d477-5d06-9cd1-1842a6e26441 with scrape type 1
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/1.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/2.jpg not downloaded yet
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8549690>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/7.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/3.jpg not downloaded yet
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f8a10>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/8.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/4.jpg not downloaded yet
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/5.jpg not downloaded yet
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcef61edbd0>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/3.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5364ed0>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/4.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64836d0>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/9.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698bd10>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/2.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e8390>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/1.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ea610>
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/10.jpg saved to cache
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/6.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/7.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/8.jpg not downloaded yet
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/9.jpg not downloaded yet
2026-03-27 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/10.jpg not downloaded yet
2026-03-27 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:57 [ayvens.de] INFO: Found listing with ID: 1987809
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987809%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [ayvens.de] INFO: Scrape type for 1987809: 1
2026-03-27 21:45:57 [ayvens.de] INFO: Extracting data for car ID: 1987809
2026-03-27 21:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-27 21:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8184e333-f1fa-5d44-a229-8c9131a814c6 with scrape type 1
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/1.jpg not downloaded yet
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/2.jpg not downloaded yet
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a34f10>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/7.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/3.jpg not downloaded yet
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a36890>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/10.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b287d0>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/8.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/4.jpg not downloaded yet
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/5.jpg not downloaded yet
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6483410>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/5.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e35ad0>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/9.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b672d0>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/5.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e36f50>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/4.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aaac10>
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F75e3f4790cfd490ea0f2b444c198e0fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/6.jpg saved to cache
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef6a67e7-7153-55d9-9602-e1b985887e85
2026-03-27 21:45:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef6a67e7-7153-55d9-9602-e1b985887e85, skipping ID generation
2026-03-27 21:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6a67e7-7153-55d9-9602-e1b985887e85 with scrape type 1
2026-03-27 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef6a67e7-7153-55d9-9602-e1b985887e85 sending to next pipeline
2026-03-27 21:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ef6a67e7-7153-55d9-9602-e1b985887e85, identifier: 1987806
2026-03-27 21:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-27 21:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806
2026-03-27 21:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ef6a67e7-7153-55d9-9602-e1b985887e85 with identifier: 1987806 to the API
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef6a67e7-7153-55d9-9602-e1b985887e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 186760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6a67e7-7153-55d9-9602-e1b985887e85/ef6a67e7-7153-55d9-9602-e1b985887e85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/75e3f4790cfd490ea0f2b444c198e0fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987806%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [ayvens.de] INFO: Saving data for 1987806: {'created_time': 1774647958.606917, 'last_price_update_time': 1774647958.606929, 'auction_closing_time': 1774875600.0}
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987806') HTTP/1.1" 204 0
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/6.jpg not downloaded yet
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/7.jpg not downloaded yet
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/8.jpg not downloaded yet
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/9.jpg not downloaded yet
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/10.jpg not downloaded yet
2026-03-27 21:45:58 [ayvens.de] INFO: Found listing with ID: 1987810
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987810%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [ayvens.de] INFO: Scrape type for 1987810: 1
2026-03-27 21:45:58 [ayvens.de] INFO: Extracting data for car ID: 1987810
2026-03-27 21:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-27 21:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334db34a-12c0-541d-95e3-0b79ffa4ad57 with scrape type 1
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/1.jpg not downloaded yet
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac2b50>
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/7.jpg saved to cache
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/2.jpg not downloaded yet
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a93f90>
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/8.jpg saved to cache
2026-03-27 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536e6d0>
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/9.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/3.jpg not downloaded yet
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/4.jpg not downloaded yet
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee854b990>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/1.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e8c90>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/2.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bfc50>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/6.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6980750>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/4.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aba610>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/3.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/5.jpg not downloaded yet
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/6.jpg not downloaded yet
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/7.jpg not downloaded yet
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/8.jpg not downloaded yet
2026-03-27 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/9.jpg not downloaded yet
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/10.jpg not downloaded yet
2026-03-27 21:45:59 [ayvens.de] INFO: Found listing with ID: 1987811
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987811%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [ayvens.de] INFO: Scrape type for 1987811: 1
2026-03-27 21:45:59 [ayvens.de] INFO: Extracting data for car ID: 1987811
2026-03-27 21:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-27 21:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b with scrape type 1
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/1.jpg not downloaded yet
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/2.jpg not downloaded yet
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6981610>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/7.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee694cc50>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/6.jpg saved to cache
2026-03-27 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5236750>
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/10.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523e2d0>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/8.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b64850>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/5.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/3.jpg not downloaded yet
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314d90>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/3.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5317a50>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/2.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/4.jpg not downloaded yet
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/5.jpg not downloaded yet
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a34d50>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/3.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/6.jpg not downloaded yet
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/7.jpg not downloaded yet
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/8.jpg not downloaded yet
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/9.jpg not downloaded yet
2026-03-27 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/10.jpg not downloaded yet
2026-03-27 21:46:00 [ayvens.de] INFO: Found listing with ID: 1987812
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987812%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [ayvens.de] INFO: Scrape type for 1987812: 1
2026-03-27 21:46:00 [ayvens.de] INFO: Extracting data for car ID: 1987812
2026-03-27 21:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-27 21:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb85985-664b-5c97-b83b-fc4b23a647cc with scrape type 1
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/1.jpg not downloaded yet
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/2.jpg not downloaded yet
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/3.jpg not downloaded yet
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5212090>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/4.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5241050>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/1.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed1910>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/5.jpg saved to cache
2026-03-27 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d55590>
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/10.jpg saved to cache
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed0b90>
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmm-%252F935369bd18cb4e5c87876cf1a8dca153%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/9.jpg saved to cache
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76a92b7d-d477-5d06-9cd1-1842a6e26441
2026-03-27 21:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76a92b7d-d477-5d06-9cd1-1842a6e26441, skipping ID generation
2026-03-27 21:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a92b7d-d477-5d06-9cd1-1842a6e26441 with scrape type 1
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76a92b7d-d477-5d06-9cd1-1842a6e26441 sending to next pipeline
2026-03-27 21:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 76a92b7d-d477-5d06-9cd1-1842a6e26441, identifier: 1987808
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c59b50>
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/2.jpg saved to cache
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/4.jpg not downloaded yet
2026-03-27 21:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-27 21:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808
2026-03-27 21:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 76a92b7d-d477-5d06-9cd1-1842a6e26441 with identifier: 1987808 to the API
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '76a92b7d-d477-5d06-9cd1-1842a6e26441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 53659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a92b7d-d477-5d06-9cd1-1842a6e26441/76a92b7d-d477-5d06-9cd1-1842a6e26441_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mm-/935369bd18cb4e5c87876cf1a8dca153/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 318d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 318d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987808%27 HTTP/1.1" 200 None
2026-03-27 21:46:01 [ayvens.de] INFO: Saving data for 1987808: {'created_time': 1774647961.98315, 'last_price_update_time': 1774647961.983164, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987808') HTTP/1.1" 204 0
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c0110>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/7.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/5.jpg not downloaded yet
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/6.jpg not downloaded yet
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520d2d0>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/6.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/7.jpg not downloaded yet
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/8.jpg not downloaded yet
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/9.jpg not downloaded yet
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/10.jpg not downloaded yet
2026-03-27 21:46:02 [ayvens.de] INFO: Found listing with ID: 1987813
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987813%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [ayvens.de] INFO: Scrape type for 1987813: 1
2026-03-27 21:46:02 [ayvens.de] INFO: Extracting data for car ID: 1987813
2026-03-27 21:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-27 21:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bca994f-e62e-5765-889a-7315dcc49884 with scrape type 1
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/1.jpg not downloaded yet
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/2.jpg not downloaded yet
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6971e10>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/6.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2f50>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/5.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533eb50>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/1.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/3.jpg not downloaded yet
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/4.jpg not downloaded yet
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cfa4d0>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/3.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52fb950>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/2.jpg saved to cache
2026-03-27 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6adb9d0>
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/4.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed00d0>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/1.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d1890>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/3.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/5.jpg not downloaded yet
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/6.jpg not downloaded yet
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/7.jpg not downloaded yet
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/8.jpg not downloaded yet
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/9.jpg not downloaded yet
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/10.jpg not downloaded yet
2026-03-27 21:46:03 [ayvens.de] INFO: Found listing with ID: 1987814
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987814%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [ayvens.de] INFO: Scrape type for 1987814: 1
2026-03-27 21:46:03 [ayvens.de] INFO: Extracting data for car ID: 1987814
2026-03-27 21:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-27 21:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c180953-cafe-5795-8743-28379de956c3 with scrape type 1
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/1.jpg not downloaded yet
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/2.jpg not downloaded yet
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ffa50>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/5.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa3ed0>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/10.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e9650>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/6.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/3.jpg not downloaded yet
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fa0d0>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/4.jpg saved to cache
2026-03-27 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1d590>
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/4.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d45310>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/3.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1c790>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/9.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fa150>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/7.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/4.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/5.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/6.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/7.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/8.jpg not downloaded yet
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/9.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/10.jpg not downloaded yet
2026-03-27 21:46:04 [ayvens.de] INFO: Found listing with ID: 1987815
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987815%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [ayvens.de] INFO: Scrape type for 1987815: 1
2026-03-27 21:46:04 [ayvens.de] INFO: Extracting data for car ID: 1987815
2026-03-27 21:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-27 21:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with scrape type 1
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/1.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/2.jpg not downloaded yet
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/3.jpg not downloaded yet
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1c3d0>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/6.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c22dd0>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/8.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2d410>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/3.jpg saved to cache
2026-03-27 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2d110>
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/7.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5373350>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/2.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6acd310>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/5.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2f890>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/1.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7207010>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/2.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/4.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/5.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/6.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/7.jpg not downloaded yet
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/8.jpg not downloaded yet
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/9.jpg not downloaded yet
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/10.jpg not downloaded yet
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:05 [ayvens.de] INFO: Found listing with ID: 1987816
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987816%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [ayvens.de] INFO: Scrape type for 1987816: 1
2026-03-27 21:46:05 [ayvens.de] INFO: Extracting data for car ID: 1987816
2026-03-27 21:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-27 21:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c with scrape type 1
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/1.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/2.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/3.jpg not downloaded yet
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8f190>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/2.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/4.jpg not downloaded yet
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b2750>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/3.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/5.jpg not downloaded yet
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/6.jpg not downloaded yet
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c70d0>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/10.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533ded0>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/6.jpg saved to cache
2026-03-27 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f6050>
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/7.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ab0d0>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/4.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b2010>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/1.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52f1810>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/5.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/7.jpg not downloaded yet
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/8.jpg not downloaded yet
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/9.jpg not downloaded yet
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/10.jpg not downloaded yet
2026-03-27 21:46:06 [ayvens.de] INFO: Found listing with ID: 1987817
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987817%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [ayvens.de] INFO: Scrape type for 1987817: 1
2026-03-27 21:46:06 [ayvens.de] INFO: Extracting data for car ID: 1987817
2026-03-27 21:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-27 21:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae with scrape type 1
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/1.jpg not downloaded yet
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/2.jpg not downloaded yet
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52362d0>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/7.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 9 pages/min), scraped 8 items (at 8 items/min)
2026-03-27 21:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/3.jpg not downloaded yet
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/4.jpg not downloaded yet
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fa8d0>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/2.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c74850>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/6.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522f590>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/4.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ccec90>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/3.jpg saved to cache
2026-03-27 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6afef10>
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/1.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5322e90>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/5.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6982790>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/10.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/5.jpg not downloaded yet
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/6.jpg not downloaded yet
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/7.jpg not downloaded yet
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/8.jpg not downloaded yet
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/9.jpg not downloaded yet
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%C3%B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lö-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/10.jpg not downloaded yet
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5378d90>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/6.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:07 [ayvens.de] INFO: Found listing with ID: 1987818
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987818%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [ayvens.de] INFO: Scrape type for 1987818: 1
2026-03-27 21:46:07 [ayvens.de] INFO: Extracting data for car ID: 1987818
2026-03-27 21:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-27 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with scrape type 1
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/1.jpg not downloaded yet
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/2.jpg not downloaded yet
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/3.jpg not downloaded yet
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698bb10>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/8.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6accd10>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/7.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee9262a50>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/1.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c58710>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/3.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2fd90>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/2.jpg saved to cache
2026-03-27 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2cd50>
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/5.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8906f90>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/4.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/4.jpg not downloaded yet
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/5.jpg not downloaded yet
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/6.jpg not downloaded yet
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/7.jpg not downloaded yet
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/8.jpg not downloaded yet
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/9.jpg not downloaded yet
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/10.jpg not downloaded yet
2026-03-27 21:46:08 [ayvens.de] INFO: Found listing with ID: 1987819
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987819%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [ayvens.de] INFO: Scrape type for 1987819: 1
2026-03-27 21:46:08 [ayvens.de] INFO: Extracting data for car ID: 1987819
2026-03-27 21:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-27 21:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with scrape type 1
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/1.jpg not downloaded yet
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/2.jpg not downloaded yet
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a89e10>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/4.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e35a50>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/6.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8843c90>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/7.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/3.jpg not downloaded yet
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d21950>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/1.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69477d0>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/10.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/4.jpg not downloaded yet
2026-03-27 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/5.jpg not downloaded yet
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ae4650>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/2.jpg saved to cache
2026-03-27 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee697ac10>
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/5.jpg saved to cache
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfcdd0>
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/3.jpg saved to cache
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/6.jpg not downloaded yet
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/7.jpg not downloaded yet
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee697ab10>
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/6.jpg saved to cache
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/8.jpg not downloaded yet
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/9.jpg not downloaded yet
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/10.jpg not downloaded yet
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8efd0>
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/7.jpg saved to cache
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533ed10>
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/9.jpg saved to cache
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:09 [ayvens.de] INFO: Found listing with ID: 1987820
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987820%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [ayvens.de] INFO: Scrape type for 1987820: 1
2026-03-27 21:46:09 [ayvens.de] INFO: Extracting data for car ID: 1987820
2026-03-27 21:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-27 21:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with scrape type 1
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/1.jpg not downloaded yet
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/2.jpg not downloaded yet
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b32610>
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/10.jpg saved to cache
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69cb950>
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/1.jpg saved to cache
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8fbd0>
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/9.jpg saved to cache
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e11250>
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fswa%252F3d5b5f2e206c4d0c9aa58e04f1783e4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/5.jpg saved to cache
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17
2026-03-27 21:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2baf6cbe-5433-5085-b718-4d69d8b7fc17, skipping ID generation
2026-03-27 21:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with scrape type 1
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2baf6cbe-5433-5085-b718-4d69d8b7fc17 sending to next pipeline
2026-03-27 21:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2baf6cbe-5433-5085-b718-4d69d8b7fc17, identifier: 1987815
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6acef50>
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fb4de7f2d252d40fca5f4ec7c1fde0f71%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/8.jpg saved to cache
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c
2026-03-27 21:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3512e5e9-2072-5b9d-80e8-9b29b80f260c, skipping ID generation
2026-03-27 21:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c with scrape type 1
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3512e5e9-2072-5b9d-80e8-9b29b80f260c sending to next pipeline
2026-03-27 21:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3512e5e9-2072-5b9d-80e8-9b29b80f260c, identifier: 1987816
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/3.jpg not downloaded yet
2026-03-27 21:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-27 21:46:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815
2026-03-27 21:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2baf6cbe-5433-5085-b718-4d69d8b7fc17 with identifier: 1987815 to the API
2026-03-27 21:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2baf6cbe-5433-5085-b718-4d69d8b7fc17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2014',
 'odometer': 167445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2baf6cbe-5433-5085-b718-4d69d8b7fc17/2baf6cbe-5433-5085-b718-4d69d8b7fc17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/swa/3d5b5f2e206c4d0c9aa58e04f1783e4e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seats_number': 8,
 'seller_name': None,
 'title': 'RENAULT Trafic 2014 RENAULT Trafic ENERGY dCi 125 Combi Expression '
          'Kombi, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 125 Combi Expression Kombi, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2018}
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987815%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [ayvens.de] INFO: Saving data for 1987815: {'created_time': 1774647971.169328, 'last_price_update_time': 1774647971.16934, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987815') HTTP/1.1" 204 0
2026-03-27 21:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-27 21:46:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816
2026-03-27 21:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3512e5e9-2072-5b9d-80e8-9b29b80f260c with identifier: 1987816 to the API
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '3512e5e9-2072-5b9d-80e8-9b29b80f260c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 96142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3512e5e9-2072-5b9d-80e8-9b29b80f260c/3512e5e9-2072-5b9d-80e8-9b29b80f260c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/b4de7f2d252d40fca5f4ec7c1fde0f71/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987816%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [ayvens.de] INFO: Saving data for 1987816: {'created_time': 1774647971.66068, 'last_price_update_time': 1774647971.660691, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987816') HTTP/1.1" 204 0
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/4.jpg not downloaded yet
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/5.jpg not downloaded yet
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/6.jpg not downloaded yet
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/7.jpg not downloaded yet
2026-03-27 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/8.jpg not downloaded yet
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/9.jpg not downloaded yet
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/10.jpg not downloaded yet
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8906dd0>
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/5.jpg saved to cache
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69b96d0>
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/4.jpg saved to cache
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:11 [ayvens.de] INFO: Found listing with ID: 1987821
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987821%27 HTTP/1.1" 200 None
2026-03-27 21:46:11 [ayvens.de] INFO: Scrape type for 1987821: 1
2026-03-27 21:46:11 [ayvens.de] INFO: Extracting data for car ID: 1987821
2026-03-27 21:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-27 21:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f45f3d-7673-513b-a5fc-a126aac5ba70 with scrape type 1
2026-03-27 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/1.jpg not downloaded yet
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/2.jpg not downloaded yet
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/3.jpg not downloaded yet
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5231850>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/2.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523e010>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/3.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523e110>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/1.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcef61f1310>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/6.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab1c50>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/7.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d635d0>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/3.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/4.jpg not downloaded yet
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/5.jpg not downloaded yet
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/6.jpg not downloaded yet
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/7.jpg not downloaded yet
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/8.jpg not downloaded yet
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/9.jpg not downloaded yet
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/10.jpg not downloaded yet
2026-03-27 21:46:12 [ayvens.de] INFO: Found listing with ID: 1987822
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987822%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [ayvens.de] INFO: Scrape type for 1987822: 1
2026-03-27 21:46:12 [ayvens.de] INFO: Extracting data for car ID: 1987822
2026-03-27 21:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-27 21:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4afe9d-4063-566b-83a4-cf5e28664e34 with scrape type 1
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/1.jpg not downloaded yet
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533d050>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/4.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b31850>
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/8.jpg saved to cache
2026-03-27 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/2.jpg not downloaded yet
2026-03-27 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/3.jpg not downloaded yet
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2cd50>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/5.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b95050>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/10.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb3310>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/10.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523d090>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/6.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1d950>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/7.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ea8d0>
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Foa-%252F88d808f141d34c89a0445677c22bec7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/9.jpg saved to cache
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304
2026-03-27 21:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fc3dcb3-8afc-5e32-8e28-c314f8364304, skipping ID generation
2026-03-27 21:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with scrape type 1
2026-03-27 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fc3dcb3-8afc-5e32-8e28-c314f8364304 sending to next pipeline
2026-03-27 21:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0fc3dcb3-8afc-5e32-8e28-c314f8364304, identifier: 1987819
2026-03-27 21:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-27 21:46:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819
2026-03-27 21:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0fc3dcb3-8afc-5e32-8e28-c314f8364304 with identifier: 1987819 to the API
2026-03-27 21:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '0fc3dcb3-8afc-5e32-8e28-c314f8364304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 95491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc3dcb3-8afc-5e32-8e28-c314f8364304/0fc3dcb3-8afc-5e32-8e28-c314f8364304_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/oa-/88d808f141d34c89a0445677c22bec7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Premium Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Premium Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2019}
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987819%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [ayvens.de] INFO: Saving data for 1987819: {'created_time': 1774647974.145616, 'last_price_update_time': 1774647974.145627, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987819') HTTP/1.1" 204 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/4.jpg not downloaded yet
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/5.jpg not downloaded yet
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ee8150>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/4.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/6.jpg not downloaded yet
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/7.jpg not downloaded yet
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a06dd0>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/3.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/8.jpg not downloaded yet
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/9.jpg not downloaded yet
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eea750>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/5.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee88488d0>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/1.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/10.jpg not downloaded yet
2026-03-27 21:46:14 [ayvens.de] INFO: Found listing with ID: 1987823
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987823%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [ayvens.de] INFO: Scrape type for 1987823: 1
2026-03-27 21:46:14 [ayvens.de] INFO: Extracting data for car ID: 1987823
2026-03-27 21:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-27 21:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b257a8d2-10f6-5902-8ae1-e44169a83343 with scrape type 1
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/1.jpg not downloaded yet
2026-03-27 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/2.jpg not downloaded yet
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522f090>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/2.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7ee10>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/1.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfa750>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/9.jpg saved to cache
2026-03-27 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d71ad0>
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/10.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648ab90>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/4.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/3.jpg not downloaded yet
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/4.jpg not downloaded yet
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5321dd0>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/3.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/5.jpg not downloaded yet
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/6.jpg not downloaded yet
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/7.jpg not downloaded yet
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/8.jpg not downloaded yet
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/9.jpg not downloaded yet
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/10.jpg not downloaded yet
2026-03-27 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:15 [ayvens.de] INFO: Found listing with ID: 1987824
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987824%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [ayvens.de] INFO: Scrape type for 1987824: 1
2026-03-27 21:46:15 [ayvens.de] INFO: Extracting data for car ID: 1987824
2026-03-27 21:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-27 21:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with scrape type 1
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/1.jpg not downloaded yet
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd0fd0>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/2.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee535b110>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/1.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b66690>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/9.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/2.jpg not downloaded yet
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d7f10>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/10.jpg saved to cache
2026-03-27 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c3bd0>
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/2.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e06dd0>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/5.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aff510>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/9.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/3.jpg not downloaded yet
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/4.jpg not downloaded yet
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a26710>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/3.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/5.jpg not downloaded yet
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/6.jpg not downloaded yet
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/7.jpg not downloaded yet
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/8.jpg not downloaded yet
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/9.jpg not downloaded yet
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/10.jpg not downloaded yet
2026-03-27 21:46:16 [ayvens.de] INFO: Found listing with ID: 1987825
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987825%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [ayvens.de] INFO: Scrape type for 1987825: 1
2026-03-27 21:46:16 [ayvens.de] INFO: Extracting data for car ID: 1987825
2026-03-27 21:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-27 21:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac9f502-c22b-54bf-8b72-197c7d71877c with scrape type 1
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/1.jpg not downloaded yet
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/2.jpg not downloaded yet
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/3.jpg not downloaded yet
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b967d0>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/5.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd3010>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/4.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5352f90>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/6.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ed3910>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/8.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5234510>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/7.jpg saved to cache
2026-03-27 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ffa50>
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/7.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/4.jpg not downloaded yet
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51e9790>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/10.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b0a010>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/1.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/5.jpg not downloaded yet
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/6.jpg not downloaded yet
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/7.jpg not downloaded yet
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/8.jpg not downloaded yet
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/9.jpg not downloaded yet
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/10.jpg not downloaded yet
2026-03-27 21:46:17 [ayvens.de] INFO: Found listing with ID: 1987826
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987826%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [ayvens.de] INFO: Scrape type for 1987826: 1
2026-03-27 21:46:17 [ayvens.de] INFO: Extracting data for car ID: 1987826
2026-03-27 21:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-27 21:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b202eabb-6a9d-5675-ba39-c39223454832 with scrape type 1
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/1.jpg not downloaded yet
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/2.jpg not downloaded yet
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e9b50>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/2.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac0290>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/1.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f3210>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/6.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5308dd0>
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/9.jpg saved to cache
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/3.jpg not downloaded yet
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f1f50>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/4.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e34c90>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/5.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/4.jpg not downloaded yet
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/5.jpg not downloaded yet
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698bc10>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/2.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2ff50>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/3.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/6.jpg not downloaded yet
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/7.jpg not downloaded yet
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/8.jpg not downloaded yet
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/9.jpg not downloaded yet
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/10.jpg not downloaded yet
2026-03-27 21:46:18 [ayvens.de] INFO: Found listing with ID: 1987827
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987827%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [ayvens.de] INFO: Scrape type for 1987827: 1
2026-03-27 21:46:18 [ayvens.de] INFO: Extracting data for car ID: 1987827
2026-03-27 21:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-27 21:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88515227-8cf6-5459-a037-07153bf076c5 with scrape type 1
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/1.jpg not downloaded yet
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/2.jpg not downloaded yet
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d0810>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/4.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6493850>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/6.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532ea90>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/3.jpg saved to cache
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/3.jpg not downloaded yet
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8840790>
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/5.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bf2950>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/4.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8556cd0>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/10.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/4.jpg not downloaded yet
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/5.jpg not downloaded yet
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bf0c10>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/3.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f6350>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/9.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/6.jpg not downloaded yet
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/7.jpg not downloaded yet
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7fdd0>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/6.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/8.jpg not downloaded yet
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/9.jpg not downloaded yet
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/10.jpg not downloaded yet
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfaf10>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/5.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1f810>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/2.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [ayvens.de] INFO: Found listing with ID: 1987828
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987828%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [ayvens.de] INFO: Scrape type for 1987828: 1
2026-03-27 21:46:19 [ayvens.de] INFO: Extracting data for car ID: 1987828
2026-03-27 21:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-27 21:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f1de79-de4e-5ea6-acdb-403764399b2f with scrape type 1
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/1.jpg not downloaded yet
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/2.jpg not downloaded yet
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b67290>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/2.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd1ad0>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/3.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d6350>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/7.jpg saved to cache
2026-03-27 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69829d0>
2026-03-27 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/1.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d7350>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/10.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/3.jpg not downloaded yet
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/4.jpg not downloaded yet
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/5.jpg not downloaded yet
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/6.jpg not downloaded yet
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/7.jpg not downloaded yet
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/8.jpg not downloaded yet
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a07dd0>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/4.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/9.jpg not downloaded yet
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/10.jpg not downloaded yet
2026-03-27 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:20 [ayvens.de] INFO: Found listing with ID: 1987829
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987829%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [ayvens.de] INFO: Scrape type for 1987829: 1
2026-03-27 21:46:20 [ayvens.de] INFO: Extracting data for car ID: 1987829
2026-03-27 21:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-27 21:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a9c1bd-8d23-5913-a3dd-c01064b41960 with scrape type 1
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/1.jpg not downloaded yet
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522d950>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/1.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee649b9d0>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/9.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6def050>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/2.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee695bdd0>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/5.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ad8b90>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/10.jpg saved to cache
2026-03-27 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e6c110>
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/3.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2010>
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/6.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/2.jpg not downloaded yet
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/3.jpg not downloaded yet
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d472d0>
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/4.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/4.jpg not downloaded yet
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/5.jpg not downloaded yet
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/6.jpg not downloaded yet
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/7.jpg not downloaded yet
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/8.jpg not downloaded yet
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/9.jpg not downloaded yet
2026-03-27 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/10.jpg not downloaded yet
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6944910>
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/9.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2ed10>
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/5.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e11a50>
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/10.jpg saved to cache
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:21 [ayvens.de] INFO: Found listing with ID: 1987830
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987830%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [ayvens.de] INFO: Scrape type for 1987830: 1
2026-03-27 21:46:21 [ayvens.de] INFO: Extracting data for car ID: 1987830
2026-03-27 21:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-27 21:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f8d120-7eb7-57e2-9516-50aa45264540 with scrape type 1
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/1.jpg not downloaded yet
2026-03-27 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee9262a50>
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/7.jpg saved to cache
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/2.jpg not downloaded yet
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/3.jpg not downloaded yet
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8906c90>
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/8.jpg saved to cache
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e11250>
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/9.jpg saved to cache
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c215d0>
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F5bea1ce698ec479dbe02e1eae4e7a085%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/6.jpg saved to cache
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88515227-8cf6-5459-a037-07153bf076c5
2026-03-27 21:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88515227-8cf6-5459-a037-07153bf076c5, skipping ID generation
2026-03-27 21:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88515227-8cf6-5459-a037-07153bf076c5 with scrape type 1
2026-03-27 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88515227-8cf6-5459-a037-07153bf076c5 sending to next pipeline
2026-03-27 21:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 88515227-8cf6-5459-a037-07153bf076c5, identifier: 1987827
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1de10>
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/2.jpg saved to cache
2026-03-27 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-27 21:46:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827
2026-03-27 21:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 88515227-8cf6-5459-a037-07153bf076c5 with identifier: 1987827 to the API
2026-03-27 21:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '88515227-8cf6-5459-a037-07153bf076c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'Leaf',
 'odometer': 31026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88515227-8cf6-5459-a037-07153bf076c5/88515227-8cf6-5459-a037-07153bf076c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/5bea1ce698ec479dbe02e1eae4e7a085/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN Leaf NISSAN Leaf 40 kWh Tekna Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'NISSAN Leaf 40 kWh Tekna Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987827%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [ayvens.de] INFO: Saving data for 1987827: {'created_time': 1774647984.395073, 'last_price_update_time': 1774647984.395083, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987827') HTTP/1.1" 204 0
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/4.jpg not downloaded yet
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/5.jpg not downloaded yet
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/6.jpg not downloaded yet
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/7.jpg not downloaded yet
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/8.jpg not downloaded yet
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/9.jpg not downloaded yet
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/10.jpg not downloaded yet
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7207290>
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/5.jpg saved to cache
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:24 [ayvens.de] INFO: Found listing with ID: 1987831
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987831%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [ayvens.de] INFO: Scrape type for 1987831: 1
2026-03-27 21:46:24 [ayvens.de] INFO: Extracting data for car ID: 1987831
2026-03-27 21:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-27 21:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052add88-9d1c-5310-9347-fd5cf7a1ae63 with scrape type 1
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/1.jpg not downloaded yet
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/2.jpg not downloaded yet
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/3.jpg not downloaded yet
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69dd390>
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/1.jpg saved to cache
2026-03-27 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a04410>
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/10.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698b450>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/4.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfd350>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/3.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6989650>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/8.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8549ed0>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/1.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dff790>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/6.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/4.jpg not downloaded yet
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/5.jpg not downloaded yet
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/6.jpg not downloaded yet
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/7.jpg not downloaded yet
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/8.jpg not downloaded yet
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/9.jpg not downloaded yet
2026-03-27 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/10.jpg not downloaded yet
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2c710>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/3.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:25 [ayvens.de] INFO: Found listing with ID: 1987832
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987832%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [ayvens.de] INFO: Scrape type for 1987832: 1
2026-03-27 21:46:25 [ayvens.de] INFO: Extracting data for car ID: 1987832
2026-03-27 21:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-27 21:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe116abe-1e90-5c09-848c-01aa25b4906b with scrape type 1
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/1.jpg not downloaded yet
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/2.jpg not downloaded yet
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/3.jpg not downloaded yet
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6946f10>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/9.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf8f10>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/6.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52ec090>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/7.jpg saved to cache
2026-03-27 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cfa710>
2026-03-27 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/5.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5321450>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/2.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf81d0>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/4.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b7c50>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/1.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/4.jpg not downloaded yet
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/5.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/6.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/7.jpg not downloaded yet
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/8.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/9.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/10.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [ayvens.de] INFO: Found listing with ID: 1987833
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987833%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [ayvens.de] INFO: Scrape type for 1987833: 1
2026-03-27 21:46:26 [ayvens.de] INFO: Extracting data for car ID: 1987833
2026-03-27 21:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-27 21:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with scrape type 1
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/1.jpg not downloaded yet
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b5f90>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/4.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648a490>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/1.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/2.jpg not downloaded yet
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fee10>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/8.jpg saved to cache
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/3.jpg not downloaded yet
2026-03-27 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/4.jpg not downloaded yet
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ccf690>
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/6.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b2ad0>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/9.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac2a90>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/7.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6983a10>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/5.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648bd90>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/10.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/5.jpg not downloaded yet
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/6.jpg not downloaded yet
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523ebd0>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/4.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/7.jpg not downloaded yet
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/8.jpg not downloaded yet
2026-03-27 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/9.jpg not downloaded yet
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523d410>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/5.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/10.jpg not downloaded yet
2026-03-27 21:46:27 [ayvens.de] INFO: Found listing with ID: 1987834
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987834%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [ayvens.de] INFO: Scrape type for 1987834: 1
2026-03-27 21:46:27 [ayvens.de] INFO: Extracting data for car ID: 1987834
2026-03-27 21:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-27 21:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836e1e80-3295-5752-844c-de3042ce5cae with scrape type 1
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/1.jpg not downloaded yet
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533ef50>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/2.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eeb550>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/3.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6947c50>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/6.jpg saved to cache
2026-03-27 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522aa50>
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/3.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69452d0>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/4.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d80c10>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/3.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/2.jpg not downloaded yet
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/3.jpg not downloaded yet
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/4.jpg not downloaded yet
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/5.jpg not downloaded yet
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/6.jpg not downloaded yet
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/7.jpg not downloaded yet
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/8.jpg not downloaded yet
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6944090>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/5.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b66990>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/2.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/9.jpg not downloaded yet
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/10.jpg not downloaded yet
2026-03-27 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:28 [ayvens.de] INFO: Found listing with ID: 1987835
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987835%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [ayvens.de] INFO: Scrape type for 1987835: 1
2026-03-27 21:46:28 [ayvens.de] INFO: Extracting data for car ID: 1987835
2026-03-27 21:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-27 21:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edebf2f-39b1-5262-af93-1b183d6505b3 with scrape type 1
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/1.jpg not downloaded yet
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac1550>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/6.jpg saved to cache
2026-03-27 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d82510>
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/8.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf8650>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/4.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6483950>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/3.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f03590>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/2.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6da8810>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/7.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/2.jpg not downloaded yet
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6abae50>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/1.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/3.jpg not downloaded yet
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/4.jpg not downloaded yet
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/5.jpg not downloaded yet
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/6.jpg not downloaded yet
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/7.jpg not downloaded yet
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/8.jpg not downloaded yet
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ccfe10>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/10.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/9.jpg not downloaded yet
2026-03-27 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b09150>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/6.jpg saved to cache
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/10.jpg not downloaded yet
2026-03-27 21:46:29 [ayvens.de] INFO: Found listing with ID: 1987836
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987836%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [ayvens.de] INFO: Scrape type for 1987836: 1
2026-03-27 21:46:29 [ayvens.de] INFO: Extracting data for car ID: 1987836
2026-03-27 21:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-27 21:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d650dde2-2ff7-5de0-b981-a3c447df8783 with scrape type 1
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/1.jpg not downloaded yet
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a04290>
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/7.jpg saved to cache
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b0a290>
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/9.jpg saved to cache
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7204d50>
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-p%252F9522b18c69cc46e5949fc97f8f20207e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/1.jpg saved to cache
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe116abe-1e90-5c09-848c-01aa25b4906b
2026-03-27 21:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe116abe-1e90-5c09-848c-01aa25b4906b, skipping ID generation
2026-03-27 21:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe116abe-1e90-5c09-848c-01aa25b4906b with scrape type 1
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe116abe-1e90-5c09-848c-01aa25b4906b sending to next pipeline
2026-03-27 21:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fe116abe-1e90-5c09-848c-01aa25b4906b, identifier: 1987832
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e36dd0>
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/5.jpg saved to cache
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee694c490>
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/9.jpg saved to cache
2026-03-27 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-27 21:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832
2026-03-27 21:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fe116abe-1e90-5c09-848c-01aa25b4906b with identifier: 1987832 to the API
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe116abe-1e90-5c09-848c-01aa25b4906b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 294522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe116abe-1e90-5c09-848c-01aa25b4906b/fe116abe-1e90-5c09-848c-01aa25b4906b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-p/9522b18c69cc46e5949fc97f8f20207e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L1H1 2,8t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L1H1 2,8t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987832%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [ayvens.de] INFO: Saving data for 1987832: {'created_time': 1774647991.469114, 'last_price_update_time': 1774647991.469129, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987832') HTTP/1.1" 204 0
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/2.jpg not downloaded yet
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/3.jpg not downloaded yet
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6def210>
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/2.jpg saved to cache
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/4.jpg not downloaded yet
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/5.jpg not downloaded yet
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a3150>
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/1.jpg saved to cache
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/6.jpg not downloaded yet
2026-03-27 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/7.jpg not downloaded yet
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2e2d0>
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/8.jpg saved to cache
2026-03-27 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b32290>
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/3.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ace050>
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/6.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a2a90>
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/4.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/8.jpg not downloaded yet
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/9.jpg not downloaded yet
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/10.jpg not downloaded yet
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa3490>
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/9.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a9fd0>
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4579ee737b54705a2f15b2a173d5f2b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/10.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7
2026-03-27 21:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7, skipping ID generation
2026-03-27 21:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with scrape type 1
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 sending to next pipeline
2026-03-27 21:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7, identifier: 1987833
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee693ff50>
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/2.jpg saved to cache
2026-03-27 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-27 21:46:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833
2026-03-27 21:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 747f8f0a-eed0-53ca-ab31-b445afeb6ca7 with identifier: 1987833 to the API
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '747f8f0a-eed0-53ca-ab31-b445afeb6ca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 49905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f8f0a-eed0-53ca-ab31-b445afeb6ca7/747f8f0a-eed0-53ca-ab31-b445afeb6ca7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4579ee737b54705a2f15b2a173d5f2b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987833%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [ayvens.de] INFO: Saving data for 1987833: {'created_time': 1774647993.089953, 'last_price_update_time': 1774647993.089965, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987833') HTTP/1.1" 204 0
2026-03-27 21:46:33 [ayvens.de] INFO: Found listing with ID: 1987837
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987837%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [ayvens.de] INFO: Scrape type for 1987837: 1
2026-03-27 21:46:33 [ayvens.de] INFO: Extracting data for car ID: 1987837
2026-03-27 21:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-27 21:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae1d44a-684e-510d-bea8-c7c74b26e8a6 with scrape type 1
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/1.jpg not downloaded yet
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/2.jpg not downloaded yet
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/3.jpg not downloaded yet
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/4.jpg not downloaded yet
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/5.jpg not downloaded yet
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/6.jpg not downloaded yet
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a8f10>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/1.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/7.jpg not downloaded yet
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/8.jpg not downloaded yet
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/9.jpg not downloaded yet
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8efd0>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/3.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6482810>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/8.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51ff590>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/10.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53497d0>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/10.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab0e10>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/4.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69dee50>
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/5.jpg saved to cache
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/10.jpg not downloaded yet
2026-03-27 21:46:33 [ayvens.de] INFO: Found listing with ID: 1987838
2026-03-27 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987838%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [ayvens.de] INFO: Scrape type for 1987838: 1
2026-03-27 21:46:34 [ayvens.de] INFO: Extracting data for car ID: 1987838
2026-03-27 21:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-27 21:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 138fcc83-86b2-5713-a312-3a45ecb88a91 with scrape type 1
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/1.jpg not downloaded yet
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6483710>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/9.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/2.jpg not downloaded yet
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf88d0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/2.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/3.jpg not downloaded yet
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/4.jpg not downloaded yet
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c0210>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/4.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee537a6d0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/3.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5359ad0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/1.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb3fd0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/5.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/5.jpg not downloaded yet
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/6.jpg not downloaded yet
2026-03-27 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6acf9d0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/7.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/7.jpg not downloaded yet
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/8.jpg not downloaded yet
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/9.jpg not downloaded yet
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8841b50>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/8.jpg saved to cache
2026-03-27 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648b8d0>
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/8.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/10.jpg not downloaded yet
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5366850>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/10.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:35 [ayvens.de] INFO: Found listing with ID: 1987839
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987839%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [ayvens.de] INFO: Scrape type for 1987839: 1
2026-03-27 21:46:35 [ayvens.de] INFO: Extracting data for car ID: 1987839
2026-03-27 21:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-27 21:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe14d394-f771-5ddc-bdab-8d9784a50990 with scrape type 1
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/1.jpg not downloaded yet
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/2.jpg not downloaded yet
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51e9790>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/9.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533c3d0>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/1.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c20110>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/2.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b3e50>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/7.jpg saved to cache
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/3.jpg not downloaded yet
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/4.jpg not downloaded yet
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/5.jpg not downloaded yet
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/6.jpg not downloaded yet
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/7.jpg not downloaded yet
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/8.jpg not downloaded yet
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/9.jpg not downloaded yet
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/10.jpg not downloaded yet
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6482c50>
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/3.jpg saved to cache
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee883ea50>
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Faf66d522115e4b349c1482793a8801fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/6.jpg saved to cache
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d650dde2-2ff7-5de0-b981-a3c447df8783
2026-03-27 21:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d650dde2-2ff7-5de0-b981-a3c447df8783, skipping ID generation
2026-03-27 21:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d650dde2-2ff7-5de0-b981-a3c447df8783 with scrape type 1
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d650dde2-2ff7-5de0-b981-a3c447df8783 sending to next pipeline
2026-03-27 21:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d650dde2-2ff7-5de0-b981-a3c447df8783, identifier: 1987836
2026-03-27 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:36 [ayvens.de] INFO: Found listing with ID: 1987840
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987840%27 HTTP/1.1" 200 None
2026-03-27 21:46:36 [ayvens.de] INFO: Scrape type for 1987840: 1
2026-03-27 21:46:36 [ayvens.de] INFO: Extracting data for car ID: 1987840
2026-03-27 21:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-27 21:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7689342-a36f-581d-b680-0171ea507b1e with scrape type 1
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/1.jpg not downloaded yet
2026-03-27 21:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-27 21:46:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836
2026-03-27 21:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d650dde2-2ff7-5de0-b981-a3c447df8783 with identifier: 1987836 to the API
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd650dde2-2ff7-5de0-b981-a3c447df8783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 177478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d650dde2-2ff7-5de0-b981-a3c447df8783/d650dde2-2ff7-5de0-b981-a3c447df8783_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/af66d522115e4b349c1482793a8801fe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia SKODA Octavia Combi 2.0 TDI DSG RS Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'SKODA Octavia Combi 2.0 TDI DSG RS Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987836%27 HTTP/1.1" 200 None
2026-03-27 21:46:36 [ayvens.de] INFO: Saving data for 1987836: {'created_time': 1774647996.880129, 'last_price_update_time': 1774647996.880141, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987836') HTTP/1.1" 204 0
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5352150>
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/8.jpg saved to cache
2026-03-27 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa0310>
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/9.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/2.jpg not downloaded yet
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/3.jpg not downloaded yet
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2c510>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/10.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6abaa10>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/1.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd03d0>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/6.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cebd50>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/7.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b17590>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/3.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/4.jpg not downloaded yet
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/5.jpg not downloaded yet
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/6.jpg not downloaded yet
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/7.jpg not downloaded yet
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/8.jpg not downloaded yet
2026-03-27 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/9.jpg not downloaded yet
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/10.jpg not downloaded yet
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d53810>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/2.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee648ab10>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/5.jpg saved to cache
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:37 [ayvens.de] INFO: Found listing with ID: 1987841
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987841%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [ayvens.de] INFO: Scrape type for 1987841: 1
2026-03-27 21:46:37 [ayvens.de] INFO: Extracting data for car ID: 1987841
2026-03-27 21:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-27 21:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with scrape type 1
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/1.jpg not downloaded yet
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/2.jpg not downloaded yet
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e04710>
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/4.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6980e50>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/9.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e363d0>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/8.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f7110>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/7.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e34cd0>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/6.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b7b90>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/2.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/3.jpg not downloaded yet
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/4.jpg not downloaded yet
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/5.jpg not downloaded yet
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/6.jpg not downloaded yet
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/7.jpg not downloaded yet
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/8.jpg not downloaded yet
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/9.jpg not downloaded yet
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/10.jpg not downloaded yet
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f7b50>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/1.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:38 [ayvens.de] INFO: Found listing with ID: 1987842
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987842%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [ayvens.de] INFO: Scrape type for 1987842: 1
2026-03-27 21:46:38 [ayvens.de] INFO: Extracting data for car ID: 1987842
2026-03-27 21:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-27 21:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90e19ec-6ff9-535f-883b-246aecf6dbd4 with scrape type 1
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/1.jpg not downloaded yet
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/2.jpg not downloaded yet
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d559d0>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/3.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5372410>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/10.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee695b050>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/6.jpg saved to cache
2026-03-27 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6973390>
2026-03-27 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/4.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee695b610>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/9.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a24710>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/1.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6959050>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/2.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/3.jpg not downloaded yet
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/4.jpg not downloaded yet
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/5.jpg not downloaded yet
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/6.jpg not downloaded yet
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/7.jpg not downloaded yet
2026-03-27 21:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/8.jpg not downloaded yet
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/9.jpg not downloaded yet
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/10.jpg not downloaded yet
2026-03-27 21:46:39 [ayvens.de] INFO: Found listing with ID: 1987843
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987843%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [ayvens.de] INFO: Scrape type for 1987843: 1
2026-03-27 21:46:39 [ayvens.de] INFO: Extracting data for car ID: 1987843
2026-03-27 21:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-27 21:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with scrape type 1
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/1.jpg not downloaded yet
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6973b10>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/8.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7d810>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/3.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a36010>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/4.jpg saved to cache
2026-03-27 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a355d0>
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/7.jpg saved to cache
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7cc50>
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/6.jpg saved to cache
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c7fa10>
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/1.jpg saved to cache
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1f610>
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/5.jpg saved to cache
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/2.jpg not downloaded yet
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8635a50>
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Ffed157f5889e47979278cadce3973876%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/5.jpg saved to cache
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe14d394-f771-5ddc-bdab-8d9784a50990
2026-03-27 21:46:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe14d394-f771-5ddc-bdab-8d9784a50990, skipping ID generation
2026-03-27 21:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe14d394-f771-5ddc-bdab-8d9784a50990 with scrape type 1
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe14d394-f771-5ddc-bdab-8d9784a50990 sending to next pipeline
2026-03-27 21:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fe14d394-f771-5ddc-bdab-8d9784a50990, identifier: 1987839
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/3.jpg not downloaded yet
2026-03-27 21:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-27 21:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839
2026-03-27 21:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fe14d394-f771-5ddc-bdab-8d9784a50990 with identifier: 1987839 to the API
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe14d394-f771-5ddc-bdab-8d9784a50990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Caddy 4',
 'odometer': 250126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe14d394-f771-5ddc-bdab-8d9784a50990/fe14d394-f771-5ddc-bdab-8d9784a50990_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/fed157f5889e47979278cadce3973876/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN Caddy 4 VW Caddy 2.0 TDI (7-Si.) DSG Maxi Comfortline '
          'Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Caddy 2.0 TDI (7-Si.) DSG Maxi Comfortline Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987839%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [ayvens.de] INFO: Saving data for 1987839: {'created_time': 1774648001.086358, 'last_price_update_time': 1774648001.08637, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987839') HTTP/1.1" 204 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/4.jpg not downloaded yet
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/5.jpg not downloaded yet
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/6.jpg not downloaded yet
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/7.jpg not downloaded yet
2026-03-27 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/8.jpg not downloaded yet
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/9.jpg not downloaded yet
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/10.jpg not downloaded yet
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b0bf10>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/10.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5212090>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/4.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:41 [ayvens.de] INFO: Found listing with ID: 1987844
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987844%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [ayvens.de] INFO: Scrape type for 1987844: 1
2026-03-27 21:46:41 [ayvens.de] INFO: Extracting data for car ID: 1987844
2026-03-27 21:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-27 21:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with scrape type 1
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/1.jpg not downloaded yet
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee694d350>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/5.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5321dd0>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/3.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/2.jpg not downloaded yet
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/3.jpg not downloaded yet
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5321690>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/1.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5309690>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/3.jpg saved to cache
2026-03-27 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f6f90>
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/2.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6afda90>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/2.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/4.jpg not downloaded yet
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/5.jpg not downloaded yet
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/6.jpg not downloaded yet
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/7.jpg not downloaded yet
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8a5d0>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/8.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5242150>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/10.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/8.jpg not downloaded yet
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/9.jpg not downloaded yet
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/10.jpg not downloaded yet
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b15e90>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/10.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533c890>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/4.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d56550>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/5.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1e2d0>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/1.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3110>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/9.jpg saved to cache
2026-03-27 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533f710>
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/2.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [ayvens.de] INFO: Found listing with ID: 1987845
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987845%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [ayvens.de] INFO: Scrape type for 1987845: 1
2026-03-27 21:46:43 [ayvens.de] INFO: Extracting data for car ID: 1987845
2026-03-27 21:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-27 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82df55c2-fb17-5385-98de-cbc04369142e with scrape type 1
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/1.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/2.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/3.jpg not downloaded yet
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/4.jpg not downloaded yet
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/5.jpg not downloaded yet
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/6.jpg not downloaded yet
2026-03-27 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/7.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/8.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/9.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/10.jpg not downloaded yet
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d55c10>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/9.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6df8790>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/3.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b2a5d0>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/4.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [ayvens.de] INFO: Found listing with ID: 1987846
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987846%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [ayvens.de] INFO: Scrape type for 1987846: 1
2026-03-27 21:46:43 [ayvens.de] INFO: Extracting data for car ID: 1987846
2026-03-27 21:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-27 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150aac3d-1733-539d-9878-e95c3f9c26a1 with scrape type 1
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/1.jpg not downloaded yet
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69442d0>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/5.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/2.jpg not downloaded yet
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/3.jpg not downloaded yet
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d21cd0>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/8.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6945b50>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/10.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee698a890>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/9.jpg saved to cache
2026-03-27 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b2a1d0>
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/1.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/4.jpg not downloaded yet
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/5.jpg not downloaded yet
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/6.jpg not downloaded yet
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/7.jpg not downloaded yet
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/8.jpg not downloaded yet
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/9.jpg not downloaded yet
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f0290>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/5.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/10.jpg not downloaded yet
2026-03-27 21:46:44 [ayvens.de] INFO: Found listing with ID: 1987847
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987847%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [ayvens.de] INFO: Scrape type for 1987847: 1
2026-03-27 21:46:44 [ayvens.de] INFO: Extracting data for car ID: 1987847
2026-03-27 21:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-27 21:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e with scrape type 1
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/1.jpg not downloaded yet
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/2.jpg not downloaded yet
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69701d0>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/7.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69dcd50>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/3.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6af4b50>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/8.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69dcd50>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/4.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab3490>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/6.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e11d10>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/2.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69df450>
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/7.jpg saved to cache
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/3.jpg not downloaded yet
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/4.jpg not downloaded yet
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/5.jpg not downloaded yet
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/6.jpg not downloaded yet
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/7.jpg not downloaded yet
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/8.jpg not downloaded yet
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/9.jpg not downloaded yet
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/10.jpg not downloaded yet
2026-03-27 21:46:45 [ayvens.de] INFO: Found listing with ID: 1987848
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987848%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [ayvens.de] INFO: Scrape type for 1987848: 1
2026-03-27 21:46:45 [ayvens.de] INFO: Extracting data for car ID: 1987848
2026-03-27 21:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-27 21:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdcd71c-4580-5026-bdf8-35897f2160fd with scrape type 1
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/1.jpg not downloaded yet
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/2.jpg not downloaded yet
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e138d0>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/10.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6945a50>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/3.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f2690>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/9.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b67090>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/10.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5323e90>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/1.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69aadd0>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/4.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/3.jpg not downloaded yet
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee883d5d0>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/1.jpg saved to cache
2026-03-27 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d62750>
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/2.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/4.jpg not downloaded yet
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/5.jpg not downloaded yet
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/6.jpg not downloaded yet
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/7.jpg not downloaded yet
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/8.jpg not downloaded yet
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/9.jpg not downloaded yet
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/10.jpg not downloaded yet
2026-03-27 21:46:46 [ayvens.de] INFO: Found listing with ID: 1987849
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987849%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [ayvens.de] INFO: Scrape type for 1987849: 1
2026-03-27 21:46:46 [ayvens.de] INFO: Extracting data for car ID: 1987849
2026-03-27 21:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-27 21:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c446a52-197c-55b3-b20c-4efa3cd816ac with scrape type 1
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/1.jpg not downloaded yet
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/2.jpg not downloaded yet
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c77a50>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/3.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3850>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/3.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5211c50>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/7.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac10d0>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/8.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d70ad0>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/10.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/3.jpg not downloaded yet
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee699a410>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/9.jpg saved to cache
2026-03-27 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b14d50>
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/2.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52375d0>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/1.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/4.jpg not downloaded yet
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/5.jpg not downloaded yet
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/6.jpg not downloaded yet
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/7.jpg not downloaded yet
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/8.jpg not downloaded yet
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/9.jpg not downloaded yet
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/10.jpg not downloaded yet
2026-03-27 21:46:47 [ayvens.de] INFO: Found listing with ID: 1987850
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987850%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [ayvens.de] INFO: Scrape type for 1987850: 1
2026-03-27 21:46:47 [ayvens.de] INFO: Extracting data for car ID: 1987850
2026-03-27 21:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-27 21:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6f661b-12a1-5dae-9017-57d0280de01d with scrape type 1
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/1.jpg not downloaded yet
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/2.jpg not downloaded yet
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ea1d0>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/2.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d718d0>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/4.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/3.jpg not downloaded yet
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69cbd10>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/5.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6998b90>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/5.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5229dd0>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/3.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69d5050>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/1.jpg saved to cache
2026-03-27 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b15d10>
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/10.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/4.jpg not downloaded yet
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/5.jpg not downloaded yet
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533ef10>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/6.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/6.jpg not downloaded yet
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/7.jpg not downloaded yet
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/8.jpg not downloaded yet
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/9.jpg not downloaded yet
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/10.jpg not downloaded yet
2026-03-27 21:46:48 [ayvens.de] INFO: Found listing with ID: 1987851
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987851%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [ayvens.de] INFO: Scrape type for 1987851: 1
2026-03-27 21:46:48 [ayvens.de] INFO: Extracting data for car ID: 1987851
2026-03-27 21:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-27 21:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f60e58-3849-5a74-9c83-c3d136a11dbe with scrape type 1
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/1.jpg not downloaded yet
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/2.jpg not downloaded yet
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d23310>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/5.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2cb90>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/6.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c31d0>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/8.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/3.jpg not downloaded yet
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a35450>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/3.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd0350>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/10.jpg saved to cache
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0dd10>
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/1.jpg saved to cache
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/4.jpg not downloaded yet
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/5.jpg not downloaded yet
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bd2cd0>
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/9.jpg saved to cache
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520ce90>
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/2.jpg saved to cache
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/6.jpg not downloaded yet
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/7.jpg not downloaded yet
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/8.jpg not downloaded yet
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/9.jpg not downloaded yet
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/10.jpg not downloaded yet
2026-03-27 21:46:49 [ayvens.de] INFO: Found listing with ID: 1987852
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987852%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [ayvens.de] INFO: Scrape type for 1987852: 1
2026-03-27 21:46:49 [ayvens.de] INFO: Extracting data for car ID: 1987852
2026-03-27 21:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-27 21:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e14295-530f-55f8-87f7-0d32e8dc73f8 with scrape type 1
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/1.jpg not downloaded yet
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/2.jpg not downloaded yet
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a05290>
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/4.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5235350>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/5.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa1090>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/4.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fa750>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/6.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/3.jpg not downloaded yet
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5231b90>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/7.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c23950>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnf-%252Fd7e792eeb33241ea8fb058745c9b9446%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/7.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfdcd71c-4580-5026-bdf8-35897f2160fd
2026-03-27 21:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfdcd71c-4580-5026-bdf8-35897f2160fd, skipping ID generation
2026-03-27 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdcd71c-4580-5026-bdf8-35897f2160fd with scrape type 1
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfdcd71c-4580-5026-bdf8-35897f2160fd sending to next pipeline
2026-03-27 21:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dfdcd71c-4580-5026-bdf8-35897f2160fd, identifier: 1987848
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c74550>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/3.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b647d0>
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/9.jpg saved to cache
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/4.jpg not downloaded yet
2026-03-27 21:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-27 21:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848
2026-03-27 21:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dfdcd71c-4580-5026-bdf8-35897f2160fd with identifier: 1987848 to the API
2026-03-27 21:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'dfdcd71c-4580-5026-bdf8-35897f2160fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 66818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdcd71c-4580-5026-bdf8-35897f2160fd/dfdcd71c-4580-5026-bdf8-35897f2160fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nf-/d7e792eeb33241ea8fb058745c9b9446/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987848%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [ayvens.de] INFO: Saving data for 1987848: {'created_time': 1774648011.198984, 'last_price_update_time': 1774648011.199002, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987848') HTTP/1.1" 204 0
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/5.jpg not downloaded yet
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/6.jpg not downloaded yet
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/7.jpg not downloaded yet
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/8.jpg not downloaded yet
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/9.jpg not downloaded yet
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/10.jpg not downloaded yet
2026-03-27 21:46:51 [ayvens.de] INFO: Found listing with ID: 1987853
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987853%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [ayvens.de] INFO: Scrape type for 1987853: 1
2026-03-27 21:46:51 [ayvens.de] INFO: Extracting data for car ID: 1987853
2026-03-27 21:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-27 21:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99bfe01-6906-5fdc-84db-f363ac460d37 with scrape type 1
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/1.jpg not downloaded yet
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/2.jpg not downloaded yet
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/3.jpg not downloaded yet
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5232590>
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/7.jpg saved to cache
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c59bd0>
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/2.jpg saved to cache
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69eb250>
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/2.jpg saved to cache
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e06d10>
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/3.jpg saved to cache
2026-03-27 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ea2d0>
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/6.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520d890>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/4.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/4.jpg not downloaded yet
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5243e50>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/5.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52414d0>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/1.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/5.jpg not downloaded yet
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/6.jpg not downloaded yet
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/7.jpg not downloaded yet
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/8.jpg not downloaded yet
2026-03-27 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/9.jpg not downloaded yet
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/10.jpg not downloaded yet
2026-03-27 21:46:52 [ayvens.de] INFO: Found listing with ID: 1987854
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987854%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [ayvens.de] INFO: Scrape type for 1987854: 1
2026-03-27 21:46:52 [ayvens.de] INFO: Extracting data for car ID: 1987854
2026-03-27 21:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-27 21:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with scrape type 1
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/1.jpg not downloaded yet
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/2.jpg not downloaded yet
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c2750>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/6.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6abb490>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/4.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1d3d0>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/7.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb05d0>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/5.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb3710>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/3.jpg saved to cache
2026-03-27 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab94d0>
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/1.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bd010>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/2.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/3.jpg not downloaded yet
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cce5d0>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/1.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/4.jpg not downloaded yet
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/5.jpg not downloaded yet
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/6.jpg not downloaded yet
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/7.jpg not downloaded yet
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/8.jpg not downloaded yet
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/9.jpg not downloaded yet
2026-03-27 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/10.jpg not downloaded yet
2026-03-27 21:46:53 [ayvens.de] INFO: Found listing with ID: 1987855
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987855%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [ayvens.de] INFO: Scrape type for 1987855: 1
2026-03-27 21:46:53 [ayvens.de] INFO: Extracting data for car ID: 1987855
2026-03-27 21:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-27 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad735daa-64f2-5158-bbd7-735033b779e0 with scrape type 1
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/1.jpg not downloaded yet
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/2.jpg not downloaded yet
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53210d0>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/3.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c9010>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/10.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1f750>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/4.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536d6d0>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/6.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1c110>
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/2.jpg saved to cache
2026-03-27 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/3.jpg not downloaded yet
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b32850>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/1.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/4.jpg not downloaded yet
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/5.jpg not downloaded yet
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac0390>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/4.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c59690>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/5.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/6.jpg not downloaded yet
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/7.jpg not downloaded yet
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/8.jpg not downloaded yet
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/9.jpg not downloaded yet
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/10.jpg not downloaded yet
2026-03-27 21:46:54 [ayvens.de] INFO: Found listing with ID: 1987856
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987856%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [ayvens.de] INFO: Scrape type for 1987856: 1
2026-03-27 21:46:54 [ayvens.de] INFO: Extracting data for car ID: 1987856
2026-03-27 21:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-27 21:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fe916e-ba37-57f7-a117-ab85c99b4909 with scrape type 1
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/1.jpg not downloaded yet
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dabed0>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/6.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/2.jpg not downloaded yet
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3250>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/7.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6deea90>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/9.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b2310>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/5.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ded150>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/8.jpg saved to cache
2026-03-27 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5369210>
2026-03-27 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/10.jpg saved to cache
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/3.jpg not downloaded yet
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/4.jpg not downloaded yet
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e35310>
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/3.jpg saved to cache
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5367dd0>
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fcb6193d4d33041708b4dcf061c395114%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/7.jpg saved to cache
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23e14295-530f-55f8-87f7-0d32e8dc73f8
2026-03-27 21:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23e14295-530f-55f8-87f7-0d32e8dc73f8, skipping ID generation
2026-03-27 21:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e14295-530f-55f8-87f7-0d32e8dc73f8 with scrape type 1
2026-03-27 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23e14295-530f-55f8-87f7-0d32e8dc73f8 sending to next pipeline
2026-03-27 21:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 23e14295-530f-55f8-87f7-0d32e8dc73f8, identifier: 1987852
2026-03-27 21:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-27 21:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852
2026-03-27 21:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 23e14295-530f-55f8-87f7-0d32e8dc73f8 with identifier: 1987852 to the API
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '23e14295-530f-55f8-87f7-0d32e8dc73f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ Elektro',
 'odometer': 64667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23e14295-530f-55f8-87f7-0d32e8dc73f8/23e14295-530f-55f8-87f7-0d32e8dc73f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/cb6193d4d33041708b4dcf061c395114/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ Elektro HYUNDAI IONIQ Elektro Style Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ Elektro Style Limousine, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987852%27 HTTP/1.1" 200 None
2026-03-27 21:46:55 [ayvens.de] INFO: Saving data for 1987852: {'created_time': 1774648015.983905, 'last_price_update_time': 1774648015.983916, 'auction_closing_time': 1774875600.0}
2026-03-27 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987852') HTTP/1.1" 204 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/5.jpg not downloaded yet
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/6.jpg not downloaded yet
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/7.jpg not downloaded yet
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/8.jpg not downloaded yet
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/9.jpg not downloaded yet
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/10.jpg not downloaded yet
2026-03-27 21:46:56 [ayvens.de] INFO: Found listing with ID: 1987857
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987857%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [ayvens.de] INFO: Scrape type for 1987857: 1
2026-03-27 21:46:56 [ayvens.de] INFO: Extracting data for car ID: 1987857
2026-03-27 21:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-27 21:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with scrape type 1
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/1.jpg not downloaded yet
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/2.jpg not downloaded yet
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d3610>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/6.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee537ad10>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/5.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52edbd0>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/10.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d54dd0>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/4.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a1f10>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/7.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5378ed0>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/1.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c5b50>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/2.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9f010>
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/3.jpg saved to cache
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/3.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/4.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/5.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/6.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/7.jpg not downloaded yet
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/8.jpg not downloaded yet
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/9.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/10.jpg not downloaded yet
2026-03-27 21:46:57 [ayvens.de] INFO: Found listing with ID: 1987769
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987769%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [ayvens.de] INFO: Scrape type for 1987769: 1
2026-03-27 21:46:57 [ayvens.de] INFO: Extracting data for car ID: 1987769
2026-03-27 21:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-27 21:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 1
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/1.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/2.jpg not downloaded yet
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/3.jpg not downloaded yet
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6968f50>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/5.jpg saved to cache
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520fe90>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/2.jpg saved to cache
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee537b450>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/6.jpg saved to cache
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520c290>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/7.jpg saved to cache
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c6a10>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/1.jpg saved to cache
2026-03-27 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d50fd0>
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/4.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5378990>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/2.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6978610>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/1.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/4.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/5.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/6.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/7.jpg not downloaded yet
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/8.jpg not downloaded yet
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/9.jpg not downloaded yet
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/10.jpg not downloaded yet
2026-03-27 21:46:58 [ayvens.de] INFO: Found listing with ID: 1987770
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987770%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [ayvens.de] INFO: Scrape type for 1987770: 1
2026-03-27 21:46:58 [ayvens.de] INFO: Extracting data for car ID: 1987770
2026-03-27 21:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-27 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/1.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/2.jpg not downloaded yet
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c71d0>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/3.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/3.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/4.jpg not downloaded yet
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/5.jpg not downloaded yet
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b09f50>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/3.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6de0850>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/1.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab20d0>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/5.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6de0890>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/4.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9fe50>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/10.jpg saved to cache
2026-03-27 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e074d0>
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/6.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5315290>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/2.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/6.jpg not downloaded yet
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/7.jpg not downloaded yet
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/8.jpg not downloaded yet
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/9.jpg not downloaded yet
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/10.jpg not downloaded yet
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [ayvens.de] INFO: Found listing with ID: 1987771
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987771%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [ayvens.de] INFO: Scrape type for 1987771: 1
2026-03-27 21:46:59 [ayvens.de] INFO: Extracting data for car ID: 1987771
2026-03-27 21:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-27 21:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/1.jpg not downloaded yet
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/2.jpg not downloaded yet
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7205c50>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/4.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/3.jpg not downloaded yet
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7204fd0>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/3.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b328d0>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/10.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/4.jpg not downloaded yet
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/5.jpg not downloaded yet
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bd350>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/9.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69701d0>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/4.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2d510>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/7.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8841590>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/6.jpg saved to cache
2026-03-27 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e34d50>
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/5.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/6.jpg not downloaded yet
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/7.jpg not downloaded yet
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/8.jpg not downloaded yet
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/9.jpg not downloaded yet
2026-03-27 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/10.jpg not downloaded yet
2026-03-27 21:47:00 [ayvens.de] INFO: Found listing with ID: 1987772
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987772%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [ayvens.de] INFO: Scrape type for 1987772: 1
2026-03-27 21:47:00 [ayvens.de] INFO: Extracting data for car ID: 1987772
2026-03-27 21:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-27 21:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/1.jpg not downloaded yet
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/2.jpg not downloaded yet
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ac3050>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/7.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522dcd0>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/5.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/3.jpg not downloaded yet
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee536f110>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/6.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a914d0>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/2.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/4.jpg not downloaded yet
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/5.jpg not downloaded yet
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a90110>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/4.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d44ad0>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/5.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ded710>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/6.jpg saved to cache
2026-03-27 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d45010>
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/3.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/6.jpg not downloaded yet
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/7.jpg not downloaded yet
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/8.jpg not downloaded yet
2026-03-27 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/9.jpg not downloaded yet
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/10.jpg not downloaded yet
2026-03-27 21:47:01 [ayvens.de] INFO: Found listing with ID: 1987773
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987773%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [ayvens.de] INFO: Scrape type for 1987773: 1
2026-03-27 21:47:01 [ayvens.de] INFO: Extracting data for car ID: 1987773
2026-03-27 21:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-27 21:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/1.jpg not downloaded yet
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/2.jpg not downloaded yet
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b65550>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/7.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2cd50>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/10.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0f8d0>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/9.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5320810>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/8.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d54150>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/2.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fa910>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/10.jpg saved to cache
2026-03-27 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8eef5d0>
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F32bc00516a3e4cc6869a9d51f33e6e17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/1.jpg saved to cache
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-27 21:47:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e43e99e6-fda1-5f2a-bce1-1804c47092dd, skipping ID generation
2026-03-27 21:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e43e99e6-fda1-5f2a-bce1-1804c47092dd sending to next pipeline
2026-03-27 21:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e43e99e6-fda1-5f2a-bce1-1804c47092dd, identifier: 1987770
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/3.jpg not downloaded yet
2026-03-27 21:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-27 21:47:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770
2026-03-27 21:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1987770 to the API
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e43e99e6-fda1-5f2a-bce1-1804c47092dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 48484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/32bc00516a3e4cc6869a9d51f33e6e17/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987770%27 HTTP/1.1" 200 None
2026-03-27 21:47:02 [ayvens.de] INFO: Saving data for 1987770: {'created_time': 1774648022.85581, 'last_price_update_time': 1774648022.855822, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987770') HTTP/1.1" 204 0
2026-03-27 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6bf3c10>
2026-03-27 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/4.jpg saved to cache
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/4.jpg not downloaded yet
2026-03-27 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/5.jpg not downloaded yet
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/6.jpg not downloaded yet
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/7.jpg not downloaded yet
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/8.jpg not downloaded yet
2026-03-27 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/9.jpg not downloaded yet
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/10.jpg not downloaded yet
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb1fd0>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/6.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ab110>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/7.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:03 [ayvens.de] INFO: Found listing with ID: 1987774
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987774%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [ayvens.de] INFO: Scrape type for 1987774: 1
2026-03-27 21:47:03 [ayvens.de] INFO: Extracting data for car ID: 1987774
2026-03-27 21:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-27 21:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/1.jpg not downloaded yet
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/2.jpg not downloaded yet
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520f810>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/2.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6969550>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/3.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6958e90>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/10.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b66c90>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/5.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ad9710>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/3.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee696a690>
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/1.jpg saved to cache
2026-03-27 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/3.jpg not downloaded yet
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/4.jpg not downloaded yet
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/5.jpg not downloaded yet
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/6.jpg not downloaded yet
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/7.jpg not downloaded yet
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/8.jpg not downloaded yet
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/9.jpg not downloaded yet
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/10.jpg not downloaded yet
2026-03-27 21:47:04 [ayvens.de] INFO: Found listing with ID: 1987775
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987775%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [ayvens.de] INFO: Scrape type for 1987775: 1
2026-03-27 21:47:04 [ayvens.de] INFO: Extracting data for car ID: 1987775
2026-03-27 21:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-27 21:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/1.jpg not downloaded yet
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53148d0>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/4.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/2.jpg not downloaded yet
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c1410>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/5.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8549f10>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/8.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8840150>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/9.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5232750>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/10.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1e3d0>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/3.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314510>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/2.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee699a050>
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/1.jpg saved to cache
2026-03-27 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/3.jpg not downloaded yet
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/4.jpg not downloaded yet
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/5.jpg not downloaded yet
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/6.jpg not downloaded yet
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/7.jpg not downloaded yet
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/8.jpg not downloaded yet
2026-03-27 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/9.jpg not downloaded yet
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/10.jpg not downloaded yet
2026-03-27 21:47:05 [ayvens.de] INFO: Found listing with ID: 1987776
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987776%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [ayvens.de] INFO: Scrape type for 1987776: 1
2026-03-27 21:47:05 [ayvens.de] INFO: Extracting data for car ID: 1987776
2026-03-27 21:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-27 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/1.jpg not downloaded yet
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c59290>
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/5.jpg saved to cache
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/2.jpg not downloaded yet
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c74950>
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/7.jpg saved to cache
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69f7c90>
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F80c3f03424c34d0086779d915aafc47d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/6.jpg saved to cache
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-27 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11342670-1c07-51fa-9975-7777a82b441e, skipping ID generation
2026-03-27 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11342670-1c07-51fa-9975-7777a82b441e sending to next pipeline
2026-03-27 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11342670-1c07-51fa-9975-7777a82b441e, identifier: 1987772
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/3.jpg not downloaded yet
2026-03-27 21:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-27 21:47:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772
2026-03-27 21:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1987772 to the API
2026-03-27 21:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11342670-1c07-51fa-9975-7777a82b441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 109877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/80c3f03424c34d0086779d915aafc47d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS '
          'Kombi, 5-türig, Automatik, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS Kombi, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987772%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [ayvens.de] INFO: Saving data for 1987772: {'created_time': 1774648026.197929, 'last_price_update_time': 1774648026.197938, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987772') HTTP/1.1" 204 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/4.jpg not downloaded yet
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6971750>
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/4.jpg saved to cache
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab9950>
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/6.jpg saved to cache
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab89d0>
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/10.jpg saved to cache
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bdad0>
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/1.jpg saved to cache
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e37250>
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/9.jpg saved to cache
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:06 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -7 pages/min), scraped 20 items (at 12 items/min)
2026-03-27 21:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 186MiB
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/5.jpg not downloaded yet
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/6.jpg not downloaded yet
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/7.jpg not downloaded yet
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/8.jpg not downloaded yet
2026-03-27 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/9.jpg not downloaded yet
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/10.jpg not downloaded yet
2026-03-27 21:47:06 [ayvens.de] INFO: Found listing with ID: 1987777
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987777%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [ayvens.de] INFO: Scrape type for 1987777: 1
2026-03-27 21:47:06 [ayvens.de] INFO: Extracting data for car ID: 1987777
2026-03-27 21:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-27 21:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/1.jpg not downloaded yet
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/2.jpg not downloaded yet
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab9110>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/4.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfa6d0>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/8.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee697b250>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/3.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8841dd0>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/2.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69795d0>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/5.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8d510>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/2.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee697b450>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/3.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/3.jpg not downloaded yet
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee533dfd0>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/1.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/4.jpg not downloaded yet
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/5.jpg not downloaded yet
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/6.jpg not downloaded yet
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/7.jpg not downloaded yet
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/8.jpg not downloaded yet
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/9.jpg not downloaded yet
2026-03-27 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/10.jpg not downloaded yet
2026-03-27 21:47:07 [ayvens.de] INFO: Found listing with ID: 1987778
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987778%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [ayvens.de] INFO: Scrape type for 1987778: 1
2026-03-27 21:47:07 [ayvens.de] INFO: Extracting data for car ID: 1987778
2026-03-27 21:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-27 21:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 1
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/1.jpg not downloaded yet
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/2.jpg not downloaded yet
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6482750>
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/10.jpg saved to cache
2026-03-27 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/3.jpg not downloaded yet
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a0810>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/3.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6970190>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/1.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aaaf50>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/2.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/4.jpg not downloaded yet
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/5.jpg not downloaded yet
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ada550>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/4.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5378050>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/10.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7204ad0>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/6.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8553a10>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/5.jpg saved to cache
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/6.jpg not downloaded yet
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/7.jpg not downloaded yet
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/8.jpg not downloaded yet
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/9.jpg not downloaded yet
2026-03-27 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-27 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/10.jpg not downloaded yet
2026-03-27 21:47:08 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51e98d0>
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/3.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ad8dd0>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/6.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eea890>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/5.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c8690>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/4.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aa8990>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/10.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f2fb10>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/9.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c9910>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/2.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aaac90>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/1.jpg saved to cache
2026-03-27 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6946b10>
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/6.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8cf90>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/5.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b942d0>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/8.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52f8950>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/4.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ceb790>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/3.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e07890>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/9.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ce9950>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/4.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8cc10>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/7.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c42d10>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/5.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69b80d0>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/6.jpg saved to cache
2026-03-27 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a1a10>
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/7.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522c210>
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/9.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8553450>
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/1.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d63fd0>
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/8.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ee8cd0>
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/2.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d16650>
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252F0bcea962d81e4970b16fd47327e44396%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/10.jpg saved to cache
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-27 21:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3139121-61f7-5733-97da-8f11b6a26a67, skipping ID generation
2026-03-27 21:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 1
2026-03-27 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3139121-61f7-5733-97da-8f11b6a26a67 sending to next pipeline
2026-03-27 21:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d3139121-61f7-5733-97da-8f11b6a26a67, identifier: 1987778
2026-03-27 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-27 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778
2026-03-27 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1987778 to the API
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3139121-61f7-5733-97da-8f11b6a26a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mondeo',
 'odometer': 92195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/0bcea962d81e4970b16fd47327e44396/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mondeo FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987778%27 HTTP/1.1" 200 None
2026-03-27 21:47:12 [ayvens.de] INFO: Saving data for 1987778: {'created_time': 1774648032.363251, 'last_price_update_time': 1774648032.363263, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987778') HTTP/1.1" 204 0
2026-03-27 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a1b90>
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/9.jpg saved to cache
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52c59d0>
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/8.jpg saved to cache
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee883fc50>
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fcec347a7415e4ebd84e4d6f72d93dec8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/10.jpg saved to cache
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-27 21:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, skipping ID generation
2026-03-27 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-27 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 sending to next pipeline
2026-03-27 21:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, identifier: 1987777
2026-03-27 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-27 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777
2026-03-27 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1987777 to the API
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'na',
 'id': '34e4ce32-4ccd-5eaa-8527-6989631e5ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'DS7',
 'odometer': 159688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/cec347a7415e4ebd84e4d6f72d93dec8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN DS7 CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE '
          'LINE + Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE LINE + '
         'Geschlossen, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987777%27 HTTP/1.1" 200 None
2026-03-27 21:47:13 [ayvens.de] INFO: Saving data for 1987777: {'created_time': 1774648033.079119, 'last_price_update_time': 1774648033.079133, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987777') HTTP/1.1" 204 0
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314d50>
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/8.jpg saved to cache
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d15e10>
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F18cff02c713c4ad7b867358ca663557d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/7.jpg saved to cache
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-27 21:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da284d19-31cb-5c93-9976-fd28ea9fe5bd, skipping ID generation
2026-03-27 21:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da284d19-31cb-5c93-9976-fd28ea9fe5bd sending to next pipeline
2026-03-27 21:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: da284d19-31cb-5c93-9976-fd28ea9fe5bd, identifier: 1987776
2026-03-27 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-27 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776
2026-03-27 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1987776 to the API
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'na',
 'id': 'da284d19-31cb-5c93-9976-fd28ea9fe5bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 141479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/18cff02c713c4ad7b867358ca663557d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987776%27 HTTP/1.1" 200 None
2026-03-27 21:47:13 [ayvens.de] INFO: Saving data for 1987776: {'created_time': 1774648033.772079, 'last_price_update_time': 1774648033.77209, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987776') HTTP/1.1" 204 0
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee534b290>
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/8.jpg saved to cache
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6968610>
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/9.jpg saved to cache
2026-03-27 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532e890>
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F88c168a241e442139f13045fc222ff40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/7.jpg saved to cache
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-27 21:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f61061d5-b02f-5a06-9fae-2f2407055e5e, skipping ID generation
2026-03-27 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f61061d5-b02f-5a06-9fae-2f2407055e5e sending to next pipeline
2026-03-27 21:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f61061d5-b02f-5a06-9fae-2f2407055e5e, identifier: 1987775
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314750>
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/7.jpg saved to cache
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-27 21:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775
2026-03-27 21:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1987775 to the API
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f61061d5-b02f-5a06-9fae-2f2407055e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 37443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 959751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/88c168a241e442139f13045fc222ff40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987775%27 HTTP/1.1" 200 None
2026-03-27 21:47:14 [ayvens.de] INFO: Saving data for 1987775: {'created_time': 1774648034.549185, 'last_price_update_time': 1774648034.549196, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987775') HTTP/1.1" 204 0
2026-03-27 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ee8650>
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F25833ee19b8b41989b5d44d6fab999ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/7.jpg saved to cache
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-27 21:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9ac5b8f-83b7-5935-9efe-bd6038786488, skipping ID generation
2026-03-27 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9ac5b8f-83b7-5935-9efe-bd6038786488 sending to next pipeline
2026-03-27 21:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9ac5b8f-83b7-5935-9efe-bd6038786488, identifier: 1987773
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5348710>
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F35fae1de19734f46ac6d90a148b5c0e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/6.jpg saved to cache
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-27 21:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, skipping ID generation
2026-03-27 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 sending to next pipeline
2026-03-27 21:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, identifier: 1987774
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee696a810>
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/8.jpg saved to cache
2026-03-27 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d14c50>
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/9.jpg saved to cache
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-27 21:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773
2026-03-27 21:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1987773 to the API
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9ac5b8f-83b7-5935-9efe-bd6038786488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 43283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/25833ee19b8b41989b5d44d6fab999ec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987773%27 HTTP/1.1" 200 None
2026-03-27 21:47:15 [ayvens.de] INFO: Saving data for 1987773: {'created_time': 1774648035.404286, 'last_price_update_time': 1774648035.404318, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987773') HTTP/1.1" 204 0
2026-03-27 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-27 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774
2026-03-27 21:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1987774 to the API
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e6d4fbc8-7897-53cb-88cc-9c02768efdf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 63566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/35fae1de19734f46ac6d90a148b5c0e0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987774%27 HTTP/1.1" 200 None
2026-03-27 21:47:15 [ayvens.de] INFO: Saving data for 1987774: {'created_time': 1774648035.723083, 'last_price_update_time': 1774648035.723096, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987774') HTTP/1.1" 204 0
2026-03-27 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c40e90>
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/2.jpg saved to cache
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d61b90>
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252Faaee260bb068483d908784ef1acdc465%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/1.jpg saved to cache
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-27 21:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e731dd25-76e8-5724-931b-52a262f9cb61, skipping ID generation
2026-03-27 21:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-27 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e731dd25-76e8-5724-931b-52a262f9cb61 sending to next pipeline
2026-03-27 21:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e731dd25-76e8-5724-931b-52a262f9cb61, identifier: 1987771
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-27 21:47:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771
2026-03-27 21:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1987771 to the API
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e731dd25-76e8-5724-931b-52a262f9cb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 80099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/aaee260bb068483d908784ef1acdc465/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987771%27 HTTP/1.1" 200 None
2026-03-27 21:47:16 [ayvens.de] INFO: Saving data for 1987771: {'created_time': 1774648036.412624, 'last_price_update_time': 1774648036.412634, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987771') HTTP/1.1" 204 0
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6aff190>
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/8.jpg saved to cache
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9d190>
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/10.jpg saved to cache
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6971ad0>
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/9.jpg saved to cache
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9e890>
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Ffec1189c9f544631aaa3a555ee502b0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/1.jpg saved to cache
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-27 21:47:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d0b11ee-57df-5dad-930b-9ad6cb904314, skipping ID generation
2026-03-27 21:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 1
2026-03-27 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 sending to next pipeline
2026-03-27 21:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1d0b11ee-57df-5dad-930b-9ad6cb904314, identifier: 1987769
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522ee10>
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/9.jpg saved to cache
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-27 21:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769
2026-03-27 21:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1987769 to the API
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d0b11ee-57df-5dad-930b-9ad6cb904314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41110',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 29241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/fec1189c9f544631aaa3a555ee502b0c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987769%27 HTTP/1.1" 200 None
2026-03-27 21:47:17 [ayvens.de] INFO: Saving data for 1987769: {'created_time': 1774648037.46844, 'last_price_update_time': 1774648037.46845, 'auction_closing_time': 1774872000.0}
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987769') HTTP/1.1" 204 0
2026-03-27 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bdbd0>
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F00da8030e2e34d21a9101897be25f5d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/8.jpg saved to cache
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0
2026-03-27 21:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0, skipping ID generation
2026-03-27 21:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with scrape type 1
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 sending to next pipeline
2026-03-27 21:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0, identifier: 1987857
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a9ee10>
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/8.jpg saved to cache
2026-03-27 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-27 21:47:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857
2026-03-27 21:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8c1ed930-f72a-55f2-b4bf-73a0a808d9b0 with identifier: 1987857 to the API
2026-03-27 21:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '8c1ed930-f72a-55f2-b4bf-73a0a808d9b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 75557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ed930-f72a-55f2-b4bf-73a0a808d9b0/8c1ed930-f72a-55f2-b4bf-73a0a808d9b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/00da8030e2e34d21a9101897be25f5d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987857%27 HTTP/1.1" 200 None
2026-03-27 21:47:18 [ayvens.de] INFO: Saving data for 1987857: {'created_time': 1774648038.129958, 'last_price_update_time': 1774648038.129968, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987857') HTTP/1.1" 204 0
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69df110>
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F4f53f98b5ad148cdb9ed8f559ecce9ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/7.jpg saved to cache
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98fe916e-ba37-57f7-a117-ab85c99b4909
2026-03-27 21:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98fe916e-ba37-57f7-a117-ab85c99b4909, skipping ID generation
2026-03-27 21:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fe916e-ba37-57f7-a117-ab85c99b4909 with scrape type 1
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98fe916e-ba37-57f7-a117-ab85c99b4909 sending to next pipeline
2026-03-27 21:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 98fe916e-ba37-57f7-a117-ab85c99b4909, identifier: 1987856
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6adb390>
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/9.jpg saved to cache
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-27 21:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856
2026-03-27 21:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 98fe916e-ba37-57f7-a117-ab85c99b4909 with identifier: 1987856 to the API
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '98fe916e-ba37-57f7-a117-ab85c99b4909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 78335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fe916e-ba37-57f7-a117-ab85c99b4909/98fe916e-ba37-57f7-a117-ab85c99b4909_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/4f53f98b5ad148cdb9ed8f559ecce9ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987856%27 HTTP/1.1" 200 None
2026-03-27 21:47:18 [ayvens.de] INFO: Saving data for 1987856: {'created_time': 1774648038.817569, 'last_price_update_time': 1774648038.817578, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987856') HTTP/1.1" 204 0
2026-03-27 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b30190>
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/9.jpg saved to cache
2026-03-27 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b2ad0>
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/10.jpg saved to cache
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d3250>
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F6adfaf84996449eda5ca367fe6b074f7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/8.jpg saved to cache
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad735daa-64f2-5158-bbd7-735033b779e0
2026-03-27 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad735daa-64f2-5158-bbd7-735033b779e0, skipping ID generation
2026-03-27 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad735daa-64f2-5158-bbd7-735033b779e0 with scrape type 1
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad735daa-64f2-5158-bbd7-735033b779e0 sending to next pipeline
2026-03-27 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ad735daa-64f2-5158-bbd7-735033b779e0, identifier: 1987855
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64444d0>
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faw-%252F45f8a4999e684a7aa98ee3e4b1b22ccd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/8.jpg saved to cache
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48
2026-03-27 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48, skipping ID generation
2026-03-27 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with scrape type 1
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 sending to next pipeline
2026-03-27 21:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48, identifier: 1987854
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee693f890>
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/8.jpg saved to cache
2026-03-27 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-27 21:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855
2026-03-27 21:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ad735daa-64f2-5158-bbd7-735033b779e0 with identifier: 1987855 to the API
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'ad735daa-64f2-5158-bbd7-735033b779e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 76313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad735daa-64f2-5158-bbd7-735033b779e0/ad735daa-64f2-5158-bbd7-735033b779e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/6adfaf84996449eda5ca367fe6b074f7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF GT Line Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987855%27 HTTP/1.1" 200 None
2026-03-27 21:47:19 [ayvens.de] INFO: Saving data for 1987855: {'created_time': 1774648039.910096, 'last_price_update_time': 1774648039.910109, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987855') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-27 21:47:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854
2026-03-27 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 62a6d7c5-ab94-5f66-bd3c-81c59ca02f48 with identifier: 1987854 to the API
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '62a6d7c5-ab94-5f66-bd3c-81c59ca02f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 135959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62a6d7c5-ab94-5f66-bd3c-81c59ca02f48/62a6d7c5-ab94-5f66-bd3c-81c59ca02f48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aw-/45f8a4999e684a7aa98ee3e4b1b22ccd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE HYUNDAI Santa Fe 2.2 CRDi 4WD Prime Geschlossen, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Santa Fe 2.2 CRDi 4WD Prime Geschlossen, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987854%27 HTTP/1.1" 200 None
2026-03-27 21:47:20 [ayvens.de] INFO: Saving data for 1987854: {'created_time': 1774648040.313042, 'last_price_update_time': 1774648040.313052, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987854') HTTP/1.1" 204 0
2026-03-27 21:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d503d0>
2026-03-27 21:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fba-%252F8354fce6bf22404b946424aedd3ac0b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/9.jpg saved to cache
2026-03-27 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d99bfe01-6906-5fdc-84db-f363ac460d37
2026-03-27 21:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d99bfe01-6906-5fdc-84db-f363ac460d37, skipping ID generation
2026-03-27 21:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99bfe01-6906-5fdc-84db-f363ac460d37 with scrape type 1
2026-03-27 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d99bfe01-6906-5fdc-84db-f363ac460d37 sending to next pipeline
2026-03-27 21:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d99bfe01-6906-5fdc-84db-f363ac460d37, identifier: 1987853
2026-03-27 21:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-27 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853
2026-03-27 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d99bfe01-6906-5fdc-84db-f363ac460d37 with identifier: 1987853 to the API
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'd99bfe01-6906-5fdc-84db-f363ac460d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 167524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99bfe01-6906-5fdc-84db-f363ac460d37/d99bfe01-6906-5fdc-84db-f363ac460d37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ba-/8354fce6bf22404b946424aedd3ac0b3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Premium Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Premium Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987853%27 HTTP/1.1" 200 None
2026-03-27 21:47:21 [ayvens.de] INFO: Saving data for 1987853: {'created_time': 1774648041.054605, 'last_price_update_time': 1774648041.054615, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987853') HTTP/1.1" 204 0
2026-03-27 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eb2250>
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/8.jpg saved to cache
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a1fed0>
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fham%252F6278bfa86c204522b6e277c877c21857%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/9.jpg saved to cache
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30f60e58-3849-5a74-9c83-c3d136a11dbe
2026-03-27 21:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f60e58-3849-5a74-9c83-c3d136a11dbe, skipping ID generation
2026-03-27 21:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f60e58-3849-5a74-9c83-c3d136a11dbe with scrape type 1
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f60e58-3849-5a74-9c83-c3d136a11dbe sending to next pipeline
2026-03-27 21:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 30f60e58-3849-5a74-9c83-c3d136a11dbe, identifier: 1987851
2026-03-27 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-27 21:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851
2026-03-27 21:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 30f60e58-3849-5a74-9c83-c3d136a11dbe with identifier: 1987851 to the API
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '30f60e58-3849-5a74-9c83-c3d136a11dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ Elektro',
 'odometer': 186427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f60e58-3849-5a74-9c83-c3d136a11dbe/30f60e58-3849-5a74-9c83-c3d136a11dbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ham/6278bfa86c204522b6e277c877c21857/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ Elektro HYUNDAI IONIQ Elektro Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ Elektro Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987851%27 HTTP/1.1" 200 None
2026-03-27 21:47:21 [ayvens.de] INFO: Saving data for 1987851: {'created_time': 1774648041.756244, 'last_price_update_time': 1774648041.756256, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987851') HTTP/1.1" 204 0
2026-03-27 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d51dd0>
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/10.jpg saved to cache
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfa810>
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/8.jpg saved to cache
2026-03-27 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5315490>
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F6f6af23456f24deb93da992d2ad5384c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/9.jpg saved to cache
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b6f661b-12a1-5dae-9017-57d0280de01d
2026-03-27 21:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b6f661b-12a1-5dae-9017-57d0280de01d, skipping ID generation
2026-03-27 21:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6f661b-12a1-5dae-9017-57d0280de01d with scrape type 1
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b6f661b-12a1-5dae-9017-57d0280de01d sending to next pipeline
2026-03-27 21:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8b6f661b-12a1-5dae-9017-57d0280de01d, identifier: 1987850
2026-03-27 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-27 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850
2026-03-27 21:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8b6f661b-12a1-5dae-9017-57d0280de01d with identifier: 1987850 to the API
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Shooting Star Grey Matt',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '8b6f661b-12a1-5dae-9017-57d0280de01d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ 5',
 'odometer': 40924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6f661b-12a1-5dae-9017-57d0280de01d/8b6f661b-12a1-5dae-9017-57d0280de01d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/6f6af23456f24deb93da992d2ad5384c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 5 HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987850%27 HTTP/1.1" 200 None
2026-03-27 21:47:22 [ayvens.de] INFO: Saving data for 1987850: {'created_time': 1774648042.487325, 'last_price_update_time': 1774648042.487336, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987850') HTTP/1.1" 204 0
2026-03-27 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5316090>
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/9.jpg saved to cache
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ee9010>
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/8.jpg saved to cache
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee695a650>
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fme-%252F1d4da680af0e4d0fada8e1377a229802%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/10.jpg saved to cache
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c446a52-197c-55b3-b20c-4efa3cd816ac
2026-03-27 21:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c446a52-197c-55b3-b20c-4efa3cd816ac, skipping ID generation
2026-03-27 21:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c446a52-197c-55b3-b20c-4efa3cd816ac with scrape type 1
2026-03-27 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c446a52-197c-55b3-b20c-4efa3cd816ac sending to next pipeline
2026-03-27 21:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c446a52-197c-55b3-b20c-4efa3cd816ac, identifier: 1987849
2026-03-27 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-27 21:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849
2026-03-27 21:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c446a52-197c-55b3-b20c-4efa3cd816ac with identifier: 1987849 to the API
2026-03-27 21:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2c446a52-197c-55b3-b20c-4efa3cd816ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 21516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c446a52-197c-55b3-b20c-4efa3cd816ac/2c446a52-197c-55b3-b20c-4efa3cd816ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/me-/1d4da680af0e4d0fada8e1377a229802/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987849%27 HTTP/1.1" 200 None
2026-03-27 21:47:23 [ayvens.de] INFO: Saving data for 1987849: {'created_time': 1774648043.234492, 'last_price_update_time': 1774648043.234503, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987849') HTTP/1.1" 204 0
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a91490>
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/8.jpg saved to cache
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cfaa90>
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/7.jpg saved to cache
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5359250>
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/4.jpg saved to cache
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5314e10>
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-h%252Fa00214d7756e4b68ae83d2553a37c232%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/6.jpg saved to cache
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e
2026-03-27 21:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17039a9e-7bc6-55af-9f86-759a0a6cc33e, skipping ID generation
2026-03-27 21:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e with scrape type 1
2026-03-27 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17039a9e-7bc6-55af-9f86-759a0a6cc33e sending to next pipeline
2026-03-27 21:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 17039a9e-7bc6-55af-9f86-759a0a6cc33e, identifier: 1987847
2026-03-27 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-27 21:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847
2026-03-27 21:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 17039a9e-7bc6-55af-9f86-759a0a6cc33e with identifier: 1987847 to the API
2026-03-27 21:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '17039a9e-7bc6-55af-9f86-759a0a6cc33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 39743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17039a9e-7bc6-55af-9f86-759a0a6cc33e/17039a9e-7bc6-55af-9f86-759a0a6cc33e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-h/a00214d7756e4b68ae83d2553a37c232/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987847%27 HTTP/1.1" 200 None
2026-03-27 21:47:24 [ayvens.de] INFO: Saving data for 1987847: {'created_time': 1774648044.120773, 'last_price_update_time': 1774648044.120782, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987847') HTTP/1.1" 204 0
2026-03-27 21:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522f190>
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/8.jpg saved to cache
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d520d0>
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbrb%252F9a9e70f5fdc541558d431f013ec67de6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/2.jpg saved to cache
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 150aac3d-1733-539d-9878-e95c3f9c26a1
2026-03-27 21:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 150aac3d-1733-539d-9878-e95c3f9c26a1, skipping ID generation
2026-03-27 21:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150aac3d-1733-539d-9878-e95c3f9c26a1 with scrape type 1
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 150aac3d-1733-539d-9878-e95c3f9c26a1 sending to next pipeline
2026-03-27 21:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 150aac3d-1733-539d-9878-e95c3f9c26a1, identifier: 1987846
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53140d0>
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/7.jpg saved to cache
2026-03-27 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-27 21:47:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846
2026-03-27 21:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 150aac3d-1733-539d-9878-e95c3f9c26a1 with identifier: 1987846 to the API
2026-03-27 21:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '150aac3d-1733-539d-9878-e95c3f9c26a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 65228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_150aac3d-1733-539d-9878-e95c3f9c26a1/150aac3d-1733-539d-9878-e95c3f9c26a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/brb/9a9e70f5fdc541558d431f013ec67de6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987846%27 HTTP/1.1" 200 None
2026-03-27 21:47:25 [ayvens.de] INFO: Saving data for 1987846: {'created_time': 1774648045.154718, 'last_price_update_time': 1774648045.154727, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987846') HTTP/1.1" 204 0
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6afda90>
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/6.jpg saved to cache
2026-03-27 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532ca50>
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F945de88e83b145748d73a2f9fccd8bad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/5.jpg saved to cache
2026-03-27 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82df55c2-fb17-5385-98de-cbc04369142e
2026-03-27 21:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82df55c2-fb17-5385-98de-cbc04369142e, skipping ID generation
2026-03-27 21:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82df55c2-fb17-5385-98de-cbc04369142e with scrape type 1
2026-03-27 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82df55c2-fb17-5385-98de-cbc04369142e sending to next pipeline
2026-03-27 21:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 82df55c2-fb17-5385-98de-cbc04369142e, identifier: 1987845
2026-03-27 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-27 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845
2026-03-27 21:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 82df55c2-fb17-5385-98de-cbc04369142e with identifier: 1987845 to the API
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '82df55c2-fb17-5385-98de-cbc04369142e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 58656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82df55c2-fb17-5385-98de-cbc04369142e/82df55c2-fb17-5385-98de-cbc04369142e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/945de88e83b145748d73a2f9fccd8bad/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987845%27 HTTP/1.1" 200 None
2026-03-27 21:47:25 [ayvens.de] INFO: Saving data for 1987845: {'created_time': 1774648045.901239, 'last_price_update_time': 1774648045.90125, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987845') HTTP/1.1" 204 0
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a063d0>
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ful-%252Fef289bf39e4b465da85731aa7e755279%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/6.jpg saved to cache
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f
2026-03-27 21:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f, skipping ID generation
2026-03-27 21:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with scrape type 1
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18d079ae-05aa-51bf-9bf3-e2ba21597e2f sending to next pipeline
2026-03-27 21:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f, identifier: 1987843
2026-03-27 21:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-27 21:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843
2026-03-27 21:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 18d079ae-05aa-51bf-9bf3-e2ba21597e2f with identifier: 1987843 to the API
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '18d079ae-05aa-51bf-9bf3-e2ba21597e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 106956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d079ae-05aa-51bf-9bf3-e2ba21597e2f/18d079ae-05aa-51bf-9bf3-e2ba21597e2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ul-/ef289bf39e4b465da85731aa7e755279/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987843%27 HTTP/1.1" 200 None
2026-03-27 21:47:26 [ayvens.de] INFO: Saving data for 1987843: {'created_time': 1774648046.594751, 'last_price_update_time': 1774648046.594761, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987843') HTTP/1.1" 204 0
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cbdad0>
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/8.jpg saved to cache
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532cd50>
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-w%252F0038f8cdb9be4b7e8b9639d8233b06c8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/9.jpg saved to cache
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a
2026-03-27 21:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a, skipping ID generation
2026-03-27 21:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with scrape type 1
2026-03-27 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bc91e22-718f-5a4f-aeb2-681e82de5d6a sending to next pipeline
2026-03-27 21:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a, identifier: 1987844
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cccd50>
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/7.jpg saved to cache
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69e9610>
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/7.jpg saved to cache
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6afc1d0>
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F37fc7e033ba54cc28e10ced07fac1ffc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/6.jpg saved to cache
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f90e19ec-6ff9-535f-883b-246aecf6dbd4
2026-03-27 21:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90e19ec-6ff9-535f-883b-246aecf6dbd4, skipping ID generation
2026-03-27 21:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90e19ec-6ff9-535f-883b-246aecf6dbd4 with scrape type 1
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90e19ec-6ff9-535f-883b-246aecf6dbd4 sending to next pipeline
2026-03-27 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f90e19ec-6ff9-535f-883b-246aecf6dbd4, identifier: 1987842
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f0d90>
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fc3fb483448af492e8aaa4ad90a2279fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/6.jpg saved to cache
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6
2026-03-27 21:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6, skipping ID generation
2026-03-27 21:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with scrape type 1
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 sending to next pipeline
2026-03-27 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6, identifier: 1987841
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5379690>
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/9.jpg saved to cache
2026-03-27 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-27 21:47:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844
2026-03-27 21:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 9bc91e22-718f-5a4f-aeb2-681e82de5d6a with identifier: 1987844 to the API
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9bc91e22-718f-5a4f-aeb2-681e82de5d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 97188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc91e22-718f-5a4f-aeb2-681e82de5d6a/9bc91e22-718f-5a4f-aeb2-681e82de5d6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-w/0038f8cdb9be4b7e8b9639d8233b06c8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987844%27 HTTP/1.1" 200 None
2026-03-27 21:47:27 [ayvens.de] INFO: Saving data for 1987844: {'created_time': 1774648047.981174, 'last_price_update_time': 1774648047.981185, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987844') HTTP/1.1" 204 0
2026-03-27 21:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-27 21:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842
2026-03-27 21:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f90e19ec-6ff9-535f-883b-246aecf6dbd4 with identifier: 1987842 to the API
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'f90e19ec-6ff9-535f-883b-246aecf6dbd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 231677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e19ec-6ff9-535f-883b-246aecf6dbd4/f90e19ec-6ff9-535f-883b-246aecf6dbd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/37fc7e033ba54cc28e10ced07fac1ffc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er BMW 520i Touring Aut. Luxury Line Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 520i Touring Aut. Luxury Line Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987842%27 HTTP/1.1" 200 None
2026-03-27 21:47:28 [ayvens.de] INFO: Saving data for 1987842: {'created_time': 1774648048.366534, 'last_price_update_time': 1774648048.366546, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987842') HTTP/1.1" 204 0
2026-03-27 21:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-27 21:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841
2026-03-27 21:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6 with identifier: 1987841 to the API
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 130928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6/449e2d3c-6f30-5d0c-8cdf-efe3f6e635e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/c3fb483448af492e8aaa4ad90a2279fb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 40 TDI quattro S tronic Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987841%27 HTTP/1.1" 200 None
2026-03-27 21:47:28 [ayvens.de] INFO: Saving data for 1987841: {'created_time': 1774648048.742207, 'last_price_update_time': 1774648048.742217, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987841') HTTP/1.1" 204 0
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8840a10>
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/4.jpg saved to cache
2026-03-27 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b16010>
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252Feda5af0fc2f14aae985c6c4295d562af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/10.jpg saved to cache
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 138fcc83-86b2-5713-a312-3a45ecb88a91
2026-03-27 21:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 138fcc83-86b2-5713-a312-3a45ecb88a91, skipping ID generation
2026-03-27 21:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 138fcc83-86b2-5713-a312-3a45ecb88a91 with scrape type 1
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 138fcc83-86b2-5713-a312-3a45ecb88a91 sending to next pipeline
2026-03-27 21:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 138fcc83-86b2-5713-a312-3a45ecb88a91, identifier: 1987838
2026-03-27 21:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-27 21:47:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838
2026-03-27 21:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 138fcc83-86b2-5713-a312-3a45ecb88a91 with identifier: 1987838 to the API
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '138fcc83-86b2-5713-a312-3a45ecb88a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 62809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138fcc83-86b2-5713-a312-3a45ecb88a91/138fcc83-86b2-5713-a312-3a45ecb88a91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/eda5af0fc2f14aae985c6c4295d562af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987838%27 HTTP/1.1" 200 None
2026-03-27 21:47:29 [ayvens.de] INFO: Saving data for 1987838: {'created_time': 1774648049.579992, 'last_price_update_time': 1774648049.580002, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987838') HTTP/1.1" 204 0
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee854b2d0>
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fa-u%252F84fb4d348b3742dfa5a47e1aa082cafb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/5.jpg saved to cache
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cae1d44a-684e-510d-bea8-c7c74b26e8a6
2026-03-27 21:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cae1d44a-684e-510d-bea8-c7c74b26e8a6, skipping ID generation
2026-03-27 21:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae1d44a-684e-510d-bea8-c7c74b26e8a6 with scrape type 1
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cae1d44a-684e-510d-bea8-c7c74b26e8a6 sending to next pipeline
2026-03-27 21:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cae1d44a-684e-510d-bea8-c7c74b26e8a6, identifier: 1987837
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520e7d0>
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/8.jpg saved to cache
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee645edd0>
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/7.jpg saved to cache
2026-03-27 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c90fd0>
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F13dd645659e2464a94f7faf76421769b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/5.jpg saved to cache
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 836e1e80-3295-5752-844c-de3042ce5cae
2026-03-27 21:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 836e1e80-3295-5752-844c-de3042ce5cae, skipping ID generation
2026-03-27 21:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836e1e80-3295-5752-844c-de3042ce5cae with scrape type 1
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 836e1e80-3295-5752-844c-de3042ce5cae sending to next pipeline
2026-03-27 21:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 836e1e80-3295-5752-844c-de3042ce5cae, identifier: 1987834
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a8a750>
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-i%252Fcf77172b37f94f11a0d1708d94392d27%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/7.jpg saved to cache
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7689342-a36f-581d-b680-0171ea507b1e
2026-03-27 21:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7689342-a36f-581d-b680-0171ea507b1e, skipping ID generation
2026-03-27 21:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7689342-a36f-581d-b680-0171ea507b1e with scrape type 1
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7689342-a36f-581d-b680-0171ea507b1e sending to next pipeline
2026-03-27 21:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a7689342-a36f-581d-b680-0171ea507b1e, identifier: 1987840
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee520ff10>
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F73f6d46aea574376b44120adb2651b58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/6.jpg saved to cache
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5edebf2f-39b1-5262-af93-1b183d6505b3
2026-03-27 21:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5edebf2f-39b1-5262-af93-1b183d6505b3, skipping ID generation
2026-03-27 21:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edebf2f-39b1-5262-af93-1b183d6505b3 with scrape type 1
2026-03-27 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5edebf2f-39b1-5262-af93-1b183d6505b3 sending to next pipeline
2026-03-27 21:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5edebf2f-39b1-5262-af93-1b183d6505b3, identifier: 1987835
2026-03-27 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-27 21:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837
2026-03-27 21:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cae1d44a-684e-510d-bea8-c7c74b26e8a6 with identifier: 1987837 to the API
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'cae1d44a-684e-510d-bea8-c7c74b26e8a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 97269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cae1d44a-684e-510d-bea8-c7c74b26e8a6/cae1d44a-684e-510d-bea8-c7c74b26e8a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/a-u/84fb4d348b3742dfa5a47e1aa082cafb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 RWD Hinterradantrieb Limousine, '
          '4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 RWD Hinterradantrieb Limousine, 4-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987837%27 HTTP/1.1" 200 None
2026-03-27 21:47:30 [ayvens.de] INFO: Saving data for 1987837: {'created_time': 1774648050.8876, 'last_price_update_time': 1774648050.887614, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987837') HTTP/1.1" 204 0
2026-03-27 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-27 21:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834
2026-03-27 21:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 836e1e80-3295-5752-844c-de3042ce5cae with identifier: 1987834 to the API
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '836e1e80-3295-5752-844c-de3042ce5cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 72005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_836e1e80-3295-5752-844c-de3042ce5cae/836e1e80-3295-5752-844c-de3042ce5cae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/13dd645659e2464a94f7faf76421769b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987834%27 HTTP/1.1" 200 None
2026-03-27 21:47:31 [ayvens.de] INFO: Saving data for 1987834: {'created_time': 1774648051.461981, 'last_price_update_time': 1774648051.46199, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987834') HTTP/1.1" 204 0
2026-03-27 21:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-27 21:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840
2026-03-27 21:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a7689342-a36f-581d-b680-0171ea507b1e with identifier: 1987840 to the API
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7689342-a36f-581d-b680-0171ea507b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 198751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7689342-a36f-581d-b680-0171ea507b1e/a7689342-a36f-581d-b680-0171ea507b1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-i/cf77172b37f94f11a0d1708d94392d27/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran VW Touran 2.0 TDI SCR Comfortline Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'VW Touran 2.0 TDI SCR Comfortline Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987840%27 HTTP/1.1" 200 None
2026-03-27 21:47:31 [ayvens.de] INFO: Saving data for 1987840: {'created_time': 1774648051.931133, 'last_price_update_time': 1774648051.931149, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987840') HTTP/1.1" 204 0
2026-03-27 21:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-27 21:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835
2026-03-27 21:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5edebf2f-39b1-5262-af93-1b183d6505b3 with identifier: 1987835 to the API
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5edebf2f-39b1-5262-af93-1b183d6505b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 55165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5edebf2f-39b1-5262-af93-1b183d6505b3/5edebf2f-39b1-5262-af93-1b183d6505b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/73f6d46aea574376b44120adb2651b58/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t '
          'Komfort Kasten, 3-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'RENAULT Trafic ENERGY dCi 145 EDC L1H1 3,0t Komfort Kasten, 3-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987835%27 HTTP/1.1" 200 None
2026-03-27 21:47:32 [ayvens.de] INFO: Saving data for 1987835: {'created_time': 1774648052.322445, 'last_price_update_time': 1774648052.322458, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987835') HTTP/1.1" 204 0
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a92750>
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/7.jpg saved to cache
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8555110>
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/10.jpg saved to cache
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee645f010>
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/8.jpg saved to cache
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d50450>
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/9.jpg saved to cache
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6982110>
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-e%252F0b072c6c0a2745fc90425563e10841f3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/8.jpg saved to cache
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28a9c1bd-8d23-5913-a3dd-c01064b41960
2026-03-27 21:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28a9c1bd-8d23-5913-a3dd-c01064b41960, skipping ID generation
2026-03-27 21:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a9c1bd-8d23-5913-a3dd-c01064b41960 with scrape type 1
2026-03-27 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28a9c1bd-8d23-5913-a3dd-c01064b41960 sending to next pipeline
2026-03-27 21:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 28a9c1bd-8d23-5913-a3dd-c01064b41960, identifier: 1987829
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a93a10>
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/10.jpg saved to cache
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8842210>
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252F53cbe69cce3946edbc5006c5a857e172%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/2.jpg saved to cache
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21f8d120-7eb7-57e2-9516-50aa45264540
2026-03-27 21:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21f8d120-7eb7-57e2-9516-50aa45264540, skipping ID generation
2026-03-27 21:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f8d120-7eb7-57e2-9516-50aa45264540 with scrape type 1
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21f8d120-7eb7-57e2-9516-50aa45264540 sending to next pipeline
2026-03-27 21:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 21f8d120-7eb7-57e2-9516-50aa45264540, identifier: 1987830
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee645f490>
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fc9c8d230e01544a7a6290a286e79c570%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/9.jpg saved to cache
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 052add88-9d1c-5310-9347-fd5cf7a1ae63
2026-03-27 21:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 052add88-9d1c-5310-9347-fd5cf7a1ae63, skipping ID generation
2026-03-27 21:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052add88-9d1c-5310-9347-fd5cf7a1ae63 with scrape type 1
2026-03-27 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 052add88-9d1c-5310-9347-fd5cf7a1ae63 sending to next pipeline
2026-03-27 21:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 052add88-9d1c-5310-9347-fd5cf7a1ae63, identifier: 1987831
2026-03-27 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-27 21:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829
2026-03-27 21:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 28a9c1bd-8d23-5913-a3dd-c01064b41960 with identifier: 1987829 to the API
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '28a9c1bd-8d23-5913-a3dd-c01064b41960',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 83381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28a9c1bd-8d23-5913-a3dd-c01064b41960/28a9c1bd-8d23-5913-a3dd-c01064b41960_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-e/0b072c6c0a2745fc90425563e10841f3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987829%27 HTTP/1.1" 200 None
2026-03-27 21:47:33 [ayvens.de] INFO: Saving data for 1987829: {'created_time': 1774648053.837974, 'last_price_update_time': 1774648053.837984, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987829') HTTP/1.1" 204 0
2026-03-27 21:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-27 21:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830
2026-03-27 21:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 21f8d120-7eb7-57e2-9516-50aa45264540 with identifier: 1987830 to the API
2026-03-27 21:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21f8d120-7eb7-57e2-9516-50aa45264540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 98365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 894695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f8d120-7eb7-57e2-9516-50aa45264540/21f8d120-7eb7-57e2-9516-50aa45264540_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/53cbe69cce3946edbc5006c5a857e172/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2017}
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987830%27 HTTP/1.1" 200 None
2026-03-27 21:47:34 [ayvens.de] INFO: Saving data for 1987830: {'created_time': 1774648054.236258, 'last_price_update_time': 1774648054.236272, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987830') HTTP/1.1" 204 0
2026-03-27 21:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-27 21:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831
2026-03-27 21:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 052add88-9d1c-5310-9347-fd5cf7a1ae63 with identifier: 1987831 to the API
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '052add88-9d1c-5310-9347-fd5cf7a1ae63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo Rapid III',
 'odometer': 145844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_052add88-9d1c-5310-9347-fd5cf7a1ae63/052add88-9d1c-5310-9347-fd5cf7a1ae63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/c9c8d230e01544a7a6290a286e79c570/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo Rapid III RENAULT Kangoo Rapid Blue dCi 95 Advance '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Blue dCi 95 Advance Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987831%27 HTTP/1.1" 200 None
2026-03-27 21:47:34 [ayvens.de] INFO: Saving data for 1987831: {'created_time': 1774648054.631017, 'last_price_update_time': 1774648054.631032, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987831') HTTP/1.1" 204 0
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b659d0>
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/8.jpg saved to cache
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b5710>
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/8.jpg saved to cache
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5309310>
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa8e142ab82084338b054deb9ec5f4444%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/7.jpg saved to cache
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89f1de79-de4e-5ea6-acdb-403764399b2f
2026-03-27 21:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89f1de79-de4e-5ea6-acdb-403764399b2f, skipping ID generation
2026-03-27 21:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f1de79-de4e-5ea6-acdb-403764399b2f with scrape type 1
2026-03-27 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89f1de79-de4e-5ea6-acdb-403764399b2f sending to next pipeline
2026-03-27 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 89f1de79-de4e-5ea6-acdb-403764399b2f, identifier: 1987828
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0ead0>
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/9.jpg saved to cache
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-27 21:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828
2026-03-27 21:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 89f1de79-de4e-5ea6-acdb-403764399b2f with identifier: 1987828 to the API
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 5,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '89f1de79-de4e-5ea6-acdb-403764399b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 141837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f1de79-de4e-5ea6-acdb-403764399b2f/89f1de79-de4e-5ea6-acdb-403764399b2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a8e142ab82084338b054deb9ec5f4444/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo ENERGY dCi 90 FAP Start & Stop '
          'LIMITED Kombi, 5-türig, 5-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo ENERGY dCi 90 FAP Start & Stop LIMITED Kombi, '
         '5-türig, 5-Gang',
 'vin': None,
 'year': 2018}
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987828%27 HTTP/1.1" 200 None
2026-03-27 21:47:35 [ayvens.de] INFO: Saving data for 1987828: {'created_time': 1774648055.535248, 'last_price_update_time': 1774648055.535258, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987828') HTTP/1.1" 204 0
2026-03-27 21:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee53089d0>
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252F52de6af8de12463abffd4bede049e1cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/7.jpg saved to cache
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b202eabb-6a9d-5675-ba39-c39223454832
2026-03-27 21:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b202eabb-6a9d-5675-ba39-c39223454832, skipping ID generation
2026-03-27 21:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b202eabb-6a9d-5675-ba39-c39223454832 with scrape type 1
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b202eabb-6a9d-5675-ba39-c39223454832 sending to next pipeline
2026-03-27 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b202eabb-6a9d-5675-ba39-c39223454832, identifier: 1987826
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5320ed0>
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fke-%252Fc20c87771b7b43bb9f3add075f322764%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/1.jpg saved to cache
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cac9f502-c22b-54bf-8b72-197c7d71877c
2026-03-27 21:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cac9f502-c22b-54bf-8b72-197c7d71877c, skipping ID generation
2026-03-27 21:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac9f502-c22b-54bf-8b72-197c7d71877c with scrape type 1
2026-03-27 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cac9f502-c22b-54bf-8b72-197c7d71877c sending to next pipeline
2026-03-27 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cac9f502-c22b-54bf-8b72-197c7d71877c, identifier: 1987825
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6de1c50>
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/8.jpg saved to cache
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69de710>
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/10.jpg saved to cache
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-27 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826
2026-03-27 21:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b202eabb-6a9d-5675-ba39-c39223454832 with identifier: 1987826 to the API
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Ebony SE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b202eabb-6a9d-5675-ba39-c39223454832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Velar',
 'odometer': 144819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b202eabb-6a9d-5675-ba39-c39223454832/b202eabb-6a9d-5675-ba39-c39223454832_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/52de6af8de12463abffd4bede049e1cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Velar LAND ROVER Range Rover Velar 3.0d '
          'R-Dynamic SE Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Velar 3.0d R-Dynamic SE Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2019}
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987826%27 HTTP/1.1" 200 None
2026-03-27 21:47:36 [ayvens.de] INFO: Saving data for 1987826: {'created_time': 1774648056.466926, 'last_price_update_time': 1774648056.466937, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987826') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-27 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825
2026-03-27 21:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cac9f502-c22b-54bf-8b72-197c7d71877c with identifier: 1987825 to the API
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cac9f502-c22b-54bf-8b72-197c7d71877c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-Klasse',
 'odometer': 161966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cac9f502-c22b-54bf-8b72-197c7d71877c/cac9f502-c22b-54bf-8b72-197c7d71877c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ke-/c20c87771b7b43bb9f3add075f322764/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-Klasse MERCEDES-BENZ E 300 de 4Matic T 9G-TRONIC '
          'AMG Line Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ E 300 de 4Matic T 9G-TRONIC AMG Line Kombi, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987825%27 HTTP/1.1" 200 None
2026-03-27 21:47:36 [ayvens.de] INFO: Saving data for 1987825: {'created_time': 1774648056.818734, 'last_price_update_time': 1774648056.818745, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987825') HTTP/1.1" 204 0
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5232f90>
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F4c11c3a20c1b4c17bcbe573415da2424%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/7.jpg saved to cache
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4
2026-03-27 21:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4, skipping ID generation
2026-03-27 21:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with scrape type 1
2026-03-27 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 sending to next pipeline
2026-03-27 21:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4, identifier: 1987824
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-27 21:47:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824
2026-03-27 21:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4 with identifier: 1987824 to the API
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Nachtschwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 124835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4/3ad6ea18-52c3-5edf-8be3-1aad2e8a0bd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/4c11c3a20c1b4c17bcbe573415da2424/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT AMG Line '
          'Limousine, 4-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT AMG Line Limousine, 4-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987824%27 HTTP/1.1" 200 None
2026-03-27 21:47:37 [ayvens.de] INFO: Saving data for 1987824: {'created_time': 1774648057.377054, 'last_price_update_time': 1774648057.377064, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987824') HTTP/1.1" 204 0
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52bfe50>
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/8.jpg saved to cache
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8553a50>
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwes%252F21eff5381a1f4de599d38074f014e22d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/8.jpg saved to cache
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b4afe9d-4063-566b-83a4-cf5e28664e34
2026-03-27 21:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b4afe9d-4063-566b-83a4-cf5e28664e34, skipping ID generation
2026-03-27 21:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4afe9d-4063-566b-83a4-cf5e28664e34 with scrape type 1
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b4afe9d-4063-566b-83a4-cf5e28664e34 sending to next pipeline
2026-03-27 21:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3b4afe9d-4063-566b-83a4-cf5e28664e34, identifier: 1987822
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cbdd90>
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/8.jpg saved to cache
2026-03-27 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-27 21:47:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822
2026-03-27 21:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3b4afe9d-4063-566b-83a4-cf5e28664e34 with identifier: 1987822 to the API
2026-03-27 21:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schneewei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': '3b4afe9d-4063-566b-83a4-cf5e28664e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 93960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4afe9d-4063-566b-83a4-cf5e28664e34/3b4afe9d-4063-566b-83a4-cf5e28664e34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wes/21eff5381a1f4de599d38074f014e22d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987822%27 HTTP/1.1" 200 None
2026-03-27 21:47:38 [ayvens.de] INFO: Saving data for 1987822: {'created_time': 1774648058.226217, 'last_price_update_time': 1774648058.226227, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987822') HTTP/1.1" 204 0
2026-03-27 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee85537d0>
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbk-%252Fb352190d7fe14e3db7d593ef25658df9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/6.jpg saved to cache
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02f45f3d-7673-513b-a5fc-a126aac5ba70
2026-03-27 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02f45f3d-7673-513b-a5fc-a126aac5ba70, skipping ID generation
2026-03-27 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f45f3d-7673-513b-a5fc-a126aac5ba70 with scrape type 1
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02f45f3d-7673-513b-a5fc-a126aac5ba70 sending to next pipeline
2026-03-27 21:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 02f45f3d-7673-513b-a5fc-a126aac5ba70, identifier: 1987821
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee523ced0>
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/7.jpg saved to cache
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee532ea10>
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-r%252F887ac89ab2f943b1b4fbfc65303a73e4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/7.jpg saved to cache
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b257a8d2-10f6-5902-8ae1-e44169a83343
2026-03-27 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b257a8d2-10f6-5902-8ae1-e44169a83343, skipping ID generation
2026-03-27 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b257a8d2-10f6-5902-8ae1-e44169a83343 with scrape type 1
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b257a8d2-10f6-5902-8ae1-e44169a83343 sending to next pipeline
2026-03-27 21:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b257a8d2-10f6-5902-8ae1-e44169a83343, identifier: 1987823
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6490510>
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252F1f591b07d3d54dd48f7cf120cdc6fd98%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/6.jpg saved to cache
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510
2026-03-27 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510, skipping ID generation
2026-03-27 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with scrape type 1
2026-03-27 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 sending to next pipeline
2026-03-27 21:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510, identifier: 1987820
2026-03-27 21:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-27 21:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821
2026-03-27 21:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 02f45f3d-7673-513b-a5fc-a126aac5ba70 with identifier: 1987821 to the API
2026-03-27 21:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '02f45f3d-7673-513b-a5fc-a126aac5ba70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 82004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f45f3d-7673-513b-a5fc-a126aac5ba70/02f45f3d-7673-513b-a5fc-a126aac5ba70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bk-/b352190d7fe14e3db7d593ef25658df9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV COOL&CONNECT Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV COOL&CONNECT Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987821%27 HTTP/1.1" 200 None
2026-03-27 21:47:39 [ayvens.de] INFO: Saving data for 1987821: {'created_time': 1774648059.209663, 'last_price_update_time': 1774648059.209672, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987821') HTTP/1.1" 204 0
2026-03-27 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-27 21:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823
2026-03-27 21:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b257a8d2-10f6-5902-8ae1-e44169a83343 with identifier: 1987823 to the API
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b257a8d2-10f6-5902-8ae1-e44169a83343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sorento',
 'odometer': 135909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b257a8d2-10f6-5902-8ae1-e44169a83343/b257a8d2-10f6-5902-8ae1-e44169a83343_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-r/887ac89ab2f943b1b4fbfc65303a73e4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sorento KIA Sorento 1.6 T-GDI PHEV AWD Aut. Platinum '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sorento 1.6 T-GDI PHEV AWD Aut. Platinum Geschlossen, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987823%27 HTTP/1.1" 200 None
2026-03-27 21:47:40 [ayvens.de] INFO: Saving data for 1987823: {'created_time': 1774648060.063411, 'last_price_update_time': 1774648060.063422, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987823') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-27 21:47:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820
2026-03-27 21:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510 with identifier: 1987820 to the API
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 59750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510/b7fcfb8e-e89c-52f6-8f9f-e2c7a55ed510_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/1f591b07d3d54dd48f7cf120cdc6fd98/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987820%27 HTTP/1.1" 200 None
2026-03-27 21:47:40 [ayvens.de] INFO: Saving data for 1987820: {'created_time': 1774648060.428208, 'last_price_update_time': 1774648060.428218, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987820') HTTP/1.1" 204 0
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b645d0>
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/8.jpg saved to cache
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee646c910>
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/8.jpg saved to cache
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b64090>
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/8.jpg saved to cache
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b96110>
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/10.jpg saved to cache
2026-03-27 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f1850>
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl%25C3%25B6-%252F3e2dcb2d9b634a43abdf1f14c93a5d09%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/9.jpg saved to cache
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae
2026-03-27 21:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8dd9675-9ee2-584f-ab33-8a05b032d0ae, skipping ID generation
2026-03-27 21:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae with scrape type 1
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8dd9675-9ee2-584f-ab33-8a05b032d0ae sending to next pipeline
2026-03-27 21:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e8dd9675-9ee2-584f-ab33-8a05b032d0ae, identifier: 1987817
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee646d050>
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flm-%252Ffcad1d0f3ff04fefaed613554d01ccfc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/2.jpg saved to cache
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6
2026-03-27 21:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6, skipping ID generation
2026-03-27 21:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with scrape type 1
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 sending to next pipeline
2026-03-27 21:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6, identifier: 1987818
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee66a8c50>
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/9.jpg saved to cache
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e2dd90>
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/4.jpg saved to cache
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51f13d0>
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F96cc1958041940079c8ce732daf3f034%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/1.jpg saved to cache
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c180953-cafe-5795-8743-28379de956c3
2026-03-27 21:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c180953-cafe-5795-8743-28379de956c3, skipping ID generation
2026-03-27 21:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c180953-cafe-5795-8743-28379de956c3 with scrape type 1
2026-03-27 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c180953-cafe-5795-8743-28379de956c3 sending to next pipeline
2026-03-27 21:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1c180953-cafe-5795-8743-28379de956c3, identifier: 1987814
2026-03-27 21:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-27 21:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817
2026-03-27 21:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e8dd9675-9ee2-584f-ab33-8a05b032d0ae with identifier: 1987817 to the API
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e8dd9675-9ee2-584f-ab33-8a05b032d0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90',
 'odometer': 200626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dd9675-9ee2-584f-ab33-8a05b032d0ae/e8dd9675-9ee2-584f-ab33-8a05b032d0ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l%C3%B6-/3e2dcb2d9b634a43abdf1f14c93a5d09/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 VOLVO V90 T6 Recharge AWD Geartronic Inscription '
          'Expression Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'VOLVO V90 T6 Recharge AWD Geartronic Inscription Expression Kombi, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987817%27 HTTP/1.1" 200 None
2026-03-27 21:47:42 [ayvens.de] INFO: Saving data for 1987817: {'created_time': 1774648062.014253, 'last_price_update_time': 1774648062.014263, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987817') HTTP/1.1" 204 0
2026-03-27 21:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-27 21:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818
2026-03-27 21:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 70aed79a-c0c2-54b7-81ee-0ace2d3544b6 with identifier: 1987818 to the API
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '70aed79a-c0c2-54b7-81ee-0ace2d3544b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Ranger',
 'odometer': 108646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aed79a-c0c2-54b7-81ee-0ace2d3544b6/70aed79a-c0c2-54b7-81ee-0ace2d3544b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lm-/fcad1d0f3ff04fefaed613554d01ccfc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Ranger FORD Ranger 2,0 l EcoBlue Autm. XLT Doppelk.Pritsche, '
          '4-türig, Automatik, 10-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Ranger 2,0 l EcoBlue Autm. XLT Doppelk.Pritsche, 4-türig, '
         'Automatik, 10-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987818%27 HTTP/1.1" 200 None
2026-03-27 21:47:42 [ayvens.de] INFO: Saving data for 1987818: {'created_time': 1774648062.36131, 'last_price_update_time': 1774648062.36132, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987818') HTTP/1.1" 204 0
2026-03-27 21:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-27 21:47:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814
2026-03-27 21:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1c180953-cafe-5795-8743-28379de956c3 with identifier: 1987814 to the API
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 50,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1c180953-cafe-5795-8743-28379de956c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 113885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c180953-cafe-5795-8743-28379de956c3/1c180953-cafe-5795-8743-28379de956c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/96cc1958041940079c8ce732daf3f034/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 e 4Matic 9G-TRONIC '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 e 4Matic 9G-TRONIC Geschlossen, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987814%27 HTTP/1.1" 200 None
2026-03-27 21:47:42 [ayvens.de] INFO: Saving data for 1987814: {'created_time': 1774648062.741748, 'last_price_update_time': 1774648062.741757, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987814') HTTP/1.1" 204 0
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ab0550>
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/9.jpg saved to cache
2026-03-27 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8c090>
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/8.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52e3f90>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/9.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6ccccd0>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/10.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6cf8950>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/8.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5316a90>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Ff6819ea770e4487b98093127afb00f58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/8.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b
2026-03-27 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91f1839d-895d-59eb-9f7e-44cd047bbe6b, skipping ID generation
2026-03-27 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b with scrape type 1
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91f1839d-895d-59eb-9f7e-44cd047bbe6b sending to next pipeline
2026-03-27 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 91f1839d-895d-59eb-9f7e-44cd047bbe6b, identifier: 1987811
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee86a7750>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252Fafc32c2e40984177ae4de3c80a687bf2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/10.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bca994f-e62e-5765-889a-7315dcc49884
2026-03-27 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bca994f-e62e-5765-889a-7315dcc49884, skipping ID generation
2026-03-27 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bca994f-e62e-5765-889a-7315dcc49884 with scrape type 1
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bca994f-e62e-5765-889a-7315dcc49884 sending to next pipeline
2026-03-27 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4bca994f-e62e-5765-889a-7315dcc49884, identifier: 1987813
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c596d0>
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F550ac9402f36494ba4053932569195f3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/9.jpg saved to cache
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffb85985-664b-5c97-b83b-fc4b23a647cc
2026-03-27 21:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffb85985-664b-5c97-b83b-fc4b23a647cc, skipping ID generation
2026-03-27 21:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb85985-664b-5c97-b83b-fc4b23a647cc with scrape type 1
2026-03-27 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffb85985-664b-5c97-b83b-fc4b23a647cc sending to next pipeline
2026-03-27 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ffb85985-664b-5c97-b83b-fc4b23a647cc, identifier: 1987812
2026-03-27 21:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-27 21:47:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811
2026-03-27 21:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 91f1839d-895d-59eb-9f7e-44cd047bbe6b with identifier: 1987811 to the API
2026-03-27 21:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '91f1839d-895d-59eb-9f7e-44cd047bbe6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 154828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f1839d-895d-59eb-9f7e-44cd047bbe6b/91f1839d-895d-59eb-9f7e-44cd047bbe6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/f6819ea770e4487b98093127afb00f58/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ACTIVE X Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ACTIVE X '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987811%27 HTTP/1.1" 200 None
2026-03-27 21:47:44 [ayvens.de] INFO: Saving data for 1987811: {'created_time': 1774648064.232541, 'last_price_update_time': 1774648064.232552, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987811') HTTP/1.1" 204 0
2026-03-27 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-27 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813
2026-03-27 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4bca994f-e62e-5765-889a-7315dcc49884 with identifier: 1987813 to the API
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '4bca994f-e62e-5765-889a-7315dcc49884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sorento',
 'odometer': 123926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bca994f-e62e-5765-889a-7315dcc49884/4bca994f-e62e-5765-889a-7315dcc49884_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/afc32c2e40984177ae4de3c80a687bf2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sorento KIA Sorento 2.2 CRDi DCT8 AWD Spirit Geschlossen, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sorento 2.2 CRDi DCT8 AWD Spirit Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987813%27 HTTP/1.1" 200 None
2026-03-27 21:47:44 [ayvens.de] INFO: Saving data for 1987813: {'created_time': 1774648064.599538, 'last_price_update_time': 1774648064.599549, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987813') HTTP/1.1" 204 0
2026-03-27 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-27 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812
2026-03-27 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ffb85985-664b-5c97-b83b-fc4b23a647cc with identifier: 1987812 to the API
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ffb85985-664b-5c97-b83b-fc4b23a647cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 58788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb85985-664b-5c97-b83b-fc4b23a647cc/ffb85985-664b-5c97-b83b-fc4b23a647cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/550ac9402f36494ba4053932569195f3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2024}
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987812%27 HTTP/1.1" 200 None
2026-03-27 21:47:45 [ayvens.de] INFO: Saving data for 1987812: {'created_time': 1774648065.038782, 'last_price_update_time': 1774648065.038793, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987812') HTTP/1.1" 204 0
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6481250>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/10.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e7db90>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/9.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69b8b50>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/5.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee51fcd50>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F241e07cf63ea433eb4afbb3c1ae89e6d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/8.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8184e333-f1fa-5d44-a229-8c9131a814c6
2026-03-27 21:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8184e333-f1fa-5d44-a229-8c9131a814c6, skipping ID generation
2026-03-27 21:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8184e333-f1fa-5d44-a229-8c9131a814c6 with scrape type 1
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8184e333-f1fa-5d44-a229-8c9131a814c6 sending to next pipeline
2026-03-27 21:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8184e333-f1fa-5d44-a229-8c9131a814c6, identifier: 1987809
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69b9650>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/2.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee530ad10>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252Fb4ff9d3e417d46bc80367edbb7d04e49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/1.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3827ca3-94ec-5f3f-996b-9f5971f76112
2026-03-27 21:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3827ca3-94ec-5f3f-996b-9f5971f76112, skipping ID generation
2026-03-27 21:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3827ca3-94ec-5f3f-996b-9f5971f76112 with scrape type 1
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3827ca3-94ec-5f3f-996b-9f5971f76112 sending to next pipeline
2026-03-27 21:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d3827ca3-94ec-5f3f-996b-9f5971f76112, identifier: 1987807
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c21110>
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fddb5b97e12aa428b9fde14610dd15755%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/6.jpg saved to cache
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 157ef602-4c35-5024-9168-76ec41d79bc9
2026-03-27 21:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 157ef602-4c35-5024-9168-76ec41d79bc9, skipping ID generation
2026-03-27 21:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157ef602-4c35-5024-9168-76ec41d79bc9 with scrape type 1
2026-03-27 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 157ef602-4c35-5024-9168-76ec41d79bc9 sending to next pipeline
2026-03-27 21:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 157ef602-4c35-5024-9168-76ec41d79bc9, identifier: 1987805
2026-03-27 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee522d950>
2026-03-27 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fki-%252F6950abac2be14b5693577b9a4ce20bbc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/7.jpg saved to cache
2026-03-27 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 334db34a-12c0-541d-95e3-0b79ffa4ad57
2026-03-27 21:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 334db34a-12c0-541d-95e3-0b79ffa4ad57, skipping ID generation
2026-03-27 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334db34a-12c0-541d-95e3-0b79ffa4ad57 with scrape type 1
2026-03-27 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 334db34a-12c0-541d-95e3-0b79ffa4ad57 sending to next pipeline
2026-03-27 21:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 334db34a-12c0-541d-95e3-0b79ffa4ad57, identifier: 1987810
2026-03-27 21:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-27 21:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809
2026-03-27 21:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8184e333-f1fa-5d44-a229-8c9131a814c6 with identifier: 1987809 to the API
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8184e333-f1fa-5d44-a229-8c9131a814c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 109974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8184e333-f1fa-5d44-a229-8c9131a814c6/8184e333-f1fa-5d44-a229-8c9131a814c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/241e07cf63ea433eb4afbb3c1ae89e6d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 330e Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 330e Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987809%27 HTTP/1.1" 200 None
2026-03-27 21:47:46 [ayvens.de] INFO: Saving data for 1987809: {'created_time': 1774648066.607309, 'last_price_update_time': 1774648066.607319, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987809') HTTP/1.1" 204 0
2026-03-27 21:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-27 21:47:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807
2026-03-27 21:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d3827ca3-94ec-5f3f-996b-9f5971f76112 with identifier: 1987807 to the API
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'd3827ca3-94ec-5f3f-996b-9f5971f76112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1er',
 'odometer': 115495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3827ca3-94ec-5f3f-996b-9f5971f76112/d3827ca3-94ec-5f3f-996b-9f5971f76112_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/b4ff9d3e417d46bc80367edbb7d04e49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er BMW 116i Limousine, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'BMW 116i Limousine, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987807%27 HTTP/1.1" 200 None
2026-03-27 21:47:47 [ayvens.de] INFO: Saving data for 1987807: {'created_time': 1774648067.00399, 'last_price_update_time': 1774648067.004001, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987807') HTTP/1.1" 204 0
2026-03-27 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-27 21:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805
2026-03-27 21:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 157ef602-4c35-5024-9168-76ec41d79bc9 with identifier: 1987805 to the API
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '157ef602-4c35-5024-9168-76ec41d79bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 9624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_157ef602-4c35-5024-9168-76ec41d79bc9/157ef602-4c35-5024-9168-76ec41d79bc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/ddb5b97e12aa428b9fde14610dd15755/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master dCi 130 L3H2 VA Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2018}
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987805%27 HTTP/1.1" 200 None
2026-03-27 21:47:47 [ayvens.de] INFO: Saving data for 1987805: {'created_time': 1774648067.379298, 'last_price_update_time': 1774648067.37931, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987805') HTTP/1.1" 204 0
2026-03-27 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-27 21:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810
2026-03-27 21:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 334db34a-12c0-541d-95e3-0b79ffa4ad57 with identifier: 1987810 to the API
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '334db34a-12c0-541d-95e3-0b79ffa4ad57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 164852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334db34a-12c0-541d-95e3-0b79ffa4ad57/334db34a-12c0-541d-95e3-0b79ffa4ad57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ki-/6950abac2be14b5693577b9a4ce20bbc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er BMW 530e xDrive Touring Aut. Kombi, 5-türig, Automatik, '
          '8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 530e xDrive Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987810%27 HTTP/1.1" 200 None
2026-03-27 21:47:47 [ayvens.de] INFO: Saving data for 1987810: {'created_time': 1774648067.779447, 'last_price_update_time': 1774648067.779458, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987810') HTTP/1.1" 204 0
2026-03-27 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee534a650>
2026-03-27 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F25fee1071828408bab1f3e2a97f5ce33%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/5.jpg saved to cache
2026-03-27 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10
2026-03-27 21:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bfdaee3-c918-523b-bb9e-9954ffeeff10, skipping ID generation
2026-03-27 21:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with scrape type 1
2026-03-27 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bfdaee3-c918-523b-bb9e-9954ffeeff10 sending to next pipeline
2026-03-27 21:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4bfdaee3-c918-523b-bb9e-9954ffeeff10, identifier: 1987804
2026-03-27 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-27 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804
2026-03-27 21:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4bfdaee3-c918-523b-bb9e-9954ffeeff10 with identifier: 1987804 to the API
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Braun',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4bfdaee3-c918-523b-bb9e-9954ffeeff10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 48543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bfdaee3-c918-523b-bb9e-9954ffeeff10/4bfdaee3-c918-523b-bb9e-9954ffeeff10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/25fee1071828408bab1f3e2a97f5ce33/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987804%27 HTTP/1.1" 200 None
2026-03-27 21:47:48 [ayvens.de] INFO: Saving data for 1987804: {'created_time': 1774648068.399511, 'last_price_update_time': 1774648068.399522, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987804') HTTP/1.1" 204 0
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b6750>
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/3.jpg saved to cache
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d14790>
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/5.jpg saved to cache
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b0cd0>
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252F4776334d8602456289084b25c8064cfe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/9.jpg saved to cache
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-27 21:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5536894-1852-55b1-99dd-4372c9a005f1, skipping ID generation
2026-03-27 21:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 1
2026-03-27 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5536894-1852-55b1-99dd-4372c9a005f1 sending to next pipeline
2026-03-27 21:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c5536894-1852-55b1-99dd-4372c9a005f1, identifier: 1987797
2026-03-27 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-27 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797
2026-03-27 21:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1987797 to the API
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c5536894-1852-55b1-99dd-4372c9a005f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 19368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/4776334d8602456289084b25c8064cfe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT AMG Line '
          'Limousine, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT AMG Line Limousine, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987797%27 HTTP/1.1" 200 None
2026-03-27 21:47:49 [ayvens.de] INFO: Saving data for 1987797: {'created_time': 1774648069.236289, 'last_price_update_time': 1774648069.236299, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987797') HTTP/1.1" 204 0
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee8843b10>
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-p%252F6717bad4e96f4ec7a35382246334f13b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/4.jpg saved to cache
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88b721d2-b05a-57f4-83b8-c11a53a63f77
2026-03-27 21:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88b721d2-b05a-57f4-83b8-c11a53a63f77, skipping ID generation
2026-03-27 21:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b721d2-b05a-57f4-83b8-c11a53a63f77 with scrape type 1
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88b721d2-b05a-57f4-83b8-c11a53a63f77 sending to next pipeline
2026-03-27 21:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 88b721d2-b05a-57f4-83b8-c11a53a63f77, identifier: 1987800
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69a2010>
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F0ae168664c484d50b88ad33a3968f50e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/6.jpg saved to cache
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acad9b67-2e5f-5e43-a57e-f3735af501a4
2026-03-27 21:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acad9b67-2e5f-5e43-a57e-f3735af501a4, skipping ID generation
2026-03-27 21:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acad9b67-2e5f-5e43-a57e-f3735af501a4 with scrape type 1
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acad9b67-2e5f-5e43-a57e-f3735af501a4 sending to next pipeline
2026-03-27 21:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: acad9b67-2e5f-5e43-a57e-f3735af501a4, identifier: 1987799
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6446690>
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmk-%252Fc52301017f2946ffb493fc0552689887%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/4.jpg saved to cache
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9
2026-03-27 21:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9, skipping ID generation
2026-03-27 21:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with scrape type 1
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 sending to next pipeline
2026-03-27 21:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9, identifier: 1987803
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6959750>
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/9.jpg saved to cache
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee7207110>
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F089a98e8a094497f905daadc99387afb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/8.jpg saved to cache
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-27 21:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1113849-b627-5942-8c72-b9129bb2ed46, skipping ID generation
2026-03-27 21:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 1
2026-03-27 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1113849-b627-5942-8c72-b9129bb2ed46 sending to next pipeline
2026-03-27 21:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d1113849-b627-5942-8c72-b9129bb2ed46, identifier: 1987796
2026-03-27 21:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-27 21:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800
2026-03-27 21:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 88b721d2-b05a-57f4-83b8-c11a53a63f77 with identifier: 1987800 to the API
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '88b721d2-b05a-57f4-83b8-c11a53a63f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 106141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b721d2-b05a-57f4-83b8-c11a53a63f77/88b721d2-b05a-57f4-83b8-c11a53a63f77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-p/6717bad4e96f4ec7a35382246334f13b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'COOL&CONNECT Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. COOL&CONNECT '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987800%27 HTTP/1.1" 200 None
2026-03-27 21:47:50 [ayvens.de] INFO: Saving data for 1987800: {'created_time': 1774648070.416924, 'last_price_update_time': 1774648070.416935, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987800') HTTP/1.1" 204 0
2026-03-27 21:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-27 21:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799
2026-03-27 21:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: acad9b67-2e5f-5e43-a57e-f3735af501a4 with identifier: 1987799 to the API
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'acad9b67-2e5f-5e43-a57e-f3735af501a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 123351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acad9b67-2e5f-5e43-a57e-f3735af501a4/acad9b67-2e5f-5e43-a57e-f3735af501a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/0ae168664c484d50b88ad33a3968f50e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987799%27 HTTP/1.1" 200 None
2026-03-27 21:47:50 [ayvens.de] INFO: Saving data for 1987799: {'created_time': 1774648070.786586, 'last_price_update_time': 1774648070.786601, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987799') HTTP/1.1" 204 0
2026-03-27 21:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-27 21:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803
2026-03-27 21:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c9b06da-843a-5d1f-9c44-a9b838e2f5c9 with identifier: 1987803 to the API
2026-03-27 21:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': '2c9b06da-843a-5d1f-9c44-a9b838e2f5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 68108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9b06da-843a-5d1f-9c44-a9b838e2f5c9/2c9b06da-843a-5d1f-9c44-a9b838e2f5c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mk-/c52301017f2946ffb493fc0552689887/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. ST-LINE Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. ST-LINE Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987803%27 HTTP/1.1" 200 None
2026-03-27 21:47:51 [ayvens.de] INFO: Saving data for 1987803: {'created_time': 1774648071.143807, 'last_price_update_time': 1774648071.143817, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987803') HTTP/1.1" 204 0
2026-03-27 21:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-27 21:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796
2026-03-27 21:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1987796 to the API
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'na',
 'id': 'd1113849-b627-5942-8c72-b9129bb2ed46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 153804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/089a98e8a094497f905daadc99387afb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987796%27 HTTP/1.1" 200 None
2026-03-27 21:47:51 [ayvens.de] INFO: Saving data for 1987796: {'created_time': 1774648071.461795, 'last_price_update_time': 1774648071.461806, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987796') HTTP/1.1" 204 0
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d50bd0>
2026-03-27 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F25465aa3dc4a49a18c8c011002cff03f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/7.jpg saved to cache
2026-03-27 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29b5c194-188c-50fc-9a0d-643cdcecce33
2026-03-27 21:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29b5c194-188c-50fc-9a0d-643cdcecce33, skipping ID generation
2026-03-27 21:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29b5c194-188c-50fc-9a0d-643cdcecce33 with scrape type 1
2026-03-27 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29b5c194-188c-50fc-9a0d-643cdcecce33 sending to next pipeline
2026-03-27 21:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 29b5c194-188c-50fc-9a0d-643cdcecce33, identifier: 1987791
2026-03-27 21:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-27 21:47:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791
2026-03-27 21:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 29b5c194-188c-50fc-9a0d-643cdcecce33 with identifier: 1987791 to the API
2026-03-27 21:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '29b5c194-188c-50fc-9a0d-643cdcecce33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 40474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29b5c194-188c-50fc-9a0d-643cdcecce33/29b5c194-188c-50fc-9a0d-643cdcecce33_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/25465aa3dc4a49a18c8c011002cff03f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987791%27 HTTP/1.1" 200 None
2026-03-27 21:47:52 [ayvens.de] INFO: Saving data for 1987791: {'created_time': 1774648072.146151, 'last_price_update_time': 1774648072.146162, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987791') HTTP/1.1" 204 0
2026-03-27 21:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f1e490>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/9.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a25610>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-r%252Ff3007d621b624f54b440a938139e506f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/8.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147
2026-03-27 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21e9ba47-e1c0-50a1-b9e3-e74991c60147, skipping ID generation
2026-03-27 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with scrape type 1
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21e9ba47-e1c0-50a1-b9e3-e74991c60147 sending to next pipeline
2026-03-27 21:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 21e9ba47-e1c0-50a1-b9e3-e74991c60147, identifier: 1987794
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c42610>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-s%252F9bc6e64e1f064469af4c3c82ce9fc4fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/8.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb
2026-03-27 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb, skipping ID generation
2026-03-27 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with scrape type 1
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c42f555-a9a2-582b-ae9f-39b4dbc419cb sending to next pipeline
2026-03-27 21:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb, identifier: 1987793
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69c9790>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/8.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c40bd0>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/9.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0ced0>
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe245b9781d0b4e32b19d4a2ac696f037%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/8.jpg saved to cache
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b932a82-f05b-5690-a011-893c32e01134
2026-03-27 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b932a82-f05b-5690-a011-893c32e01134, skipping ID generation
2026-03-27 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b932a82-f05b-5690-a011-893c32e01134 with scrape type 1
2026-03-27 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b932a82-f05b-5690-a011-893c32e01134 sending to next pipeline
2026-03-27 21:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7b932a82-f05b-5690-a011-893c32e01134, identifier: 1987795
2026-03-27 21:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6de1dd0>
2026-03-27 21:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fa7468f9f3d214a2aa3fa972a5faef57f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/9.jpg saved to cache
2026-03-27 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c482979-bb1e-5dac-9b73-7dcb854faea9
2026-03-27 21:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c482979-bb1e-5dac-9b73-7dcb854faea9, skipping ID generation
2026-03-27 21:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c482979-bb1e-5dac-9b73-7dcb854faea9 with scrape type 1
2026-03-27 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c482979-bb1e-5dac-9b73-7dcb854faea9 sending to next pipeline
2026-03-27 21:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7c482979-bb1e-5dac-9b73-7dcb854faea9, identifier: 1987792
2026-03-27 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-27 21:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794
2026-03-27 21:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 21e9ba47-e1c0-50a1-b9e3-e74991c60147 with identifier: 1987794 to the API
2026-03-27 21:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21e9ba47-e1c0-50a1-b9e3-e74991c60147',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Tourneo Custom',
 'odometer': 153086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e9ba47-e1c0-50a1-b9e3-e74991c60147/21e9ba47-e1c0-50a1-b9e3-e74991c60147_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-r/f3007d621b624f54b440a938139e506f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 8,
 'seller_name': None,
 'title': 'FORD Tourneo Custom FORD Tourneo Custom 320 L2H1 VA Autm. Active '
          'Bus, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Tourneo Custom 320 L2H1 VA Autm. Active Bus, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987794%27 HTTP/1.1" 200 None
2026-03-27 21:47:54 [ayvens.de] INFO: Saving data for 1987794: {'created_time': 1774648074.407991, 'last_price_update_time': 1774648074.408002, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987794') HTTP/1.1" 204 0
2026-03-27 21:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-27 21:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793
2026-03-27 21:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2c42f555-a9a2-582b-ae9f-39b4dbc419cb with identifier: 1987793 to the API
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c42f555-a9a2-582b-ae9f-39b4dbc419cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-Max',
 'odometer': 125194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c42f555-a9a2-582b-ae9f-39b4dbc419cb/2c42f555-a9a2-582b-ae9f-39b4dbc419cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-s/9bc6e64e1f064469af4c3c82ce9fc4fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-Max FORD S-Max 2.0 EcoBlue Aut. TITANIUM Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD S-Max 2.0 EcoBlue Aut. TITANIUM Kombi, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987793%27 HTTP/1.1" 200 None
2026-03-27 21:47:54 [ayvens.de] INFO: Saving data for 1987793: {'created_time': 1774648074.805761, 'last_price_update_time': 1774648074.805771, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987793') HTTP/1.1" 204 0
2026-03-27 21:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-27 21:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795
2026-03-27 21:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7b932a82-f05b-5690-a011-893c32e01134 with identifier: 1987795 to the API
2026-03-27 21:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b932a82-f05b-5690-a011-893c32e01134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Custom',
 'odometer': 116223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 972669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b932a82-f05b-5690-a011-893c32e01134/7b932a82-f05b-5690-a011-893c32e01134_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e245b9781d0b4e32b19d4a2ac696f037/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit Custom FORD Transit Custom 340 L1H2 LKW VA Trend '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Custom 340 L1H2 LKW VA Trend Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987795%27 HTTP/1.1" 200 None
2026-03-27 21:47:55 [ayvens.de] INFO: Saving data for 1987795: {'created_time': 1774648075.179054, 'last_price_update_time': 1774648075.179068, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987795') HTTP/1.1" 204 0
2026-03-27 21:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-27 21:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792
2026-03-27 21:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7c482979-bb1e-5dac-9b73-7dcb854faea9 with identifier: 1987792 to the API
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c482979-bb1e-5dac-9b73-7dcb854faea9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mondeo',
 'odometer': 264554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c482979-bb1e-5dac-9b73-7dcb854faea9/7c482979-bb1e-5dac-9b73-7dcb854faea9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/a7468f9f3d214a2aa3fa972a5faef57f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mondeo FORD Mondeo Turnier 2.0 EcoBlue Aut. ST-Line Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Mondeo Turnier 2.0 EcoBlue Aut. ST-Line Kombi, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987792%27 HTTP/1.1" 200 None
2026-03-27 21:47:55 [ayvens.de] INFO: Saving data for 1987792: {'created_time': 1774648075.544018, 'last_price_update_time': 1774648075.544027, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987792') HTTP/1.1" 204 0
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69ab110>
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/9.jpg saved to cache
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e7fa50>
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/8.jpg saved to cache
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee646ccd0>
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/10.jpg saved to cache
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52d2090>
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/9.jpg saved to cache
2026-03-27 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6decfd0>
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/8.jpg saved to cache
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b07d0>
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frw-%252F6fd8b709c33e4bf7976ce8fed87f8dba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/8.jpg saved to cache
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbc40d71-74f4-5f23-bae5-672a480991f4
2026-03-27 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbc40d71-74f4-5f23-bae5-672a480991f4, skipping ID generation
2026-03-27 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc40d71-74f4-5f23-bae5-672a480991f4 with scrape type 1
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbc40d71-74f4-5f23-bae5-672a480991f4 sending to next pipeline
2026-03-27 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dbc40d71-74f4-5f23-bae5-672a480991f4, identifier: 1987790
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d71850>
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/9.jpg saved to cache
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee64b05d0>
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F36e835406aed41539e0710dab85ad243%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/7.jpg saved to cache
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9
2026-03-27 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9, skipping ID generation
2026-03-27 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with scrape type 1
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 sending to next pipeline
2026-03-27 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9, identifier: 1987789
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6e7cd90>
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhn-%252Fee619e6d8d3a4216bb8a1b3353ecfb02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/7.jpg saved to cache
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9
2026-03-27 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9, skipping ID generation
2026-03-27 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with scrape type 1
2026-03-27 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 sending to next pipeline
2026-03-27 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9, identifier: 1987788
2026-03-27 21:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-27 21:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790
2026-03-27 21:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dbc40d71-74f4-5f23-bae5-672a480991f4 with identifier: 1987790 to the API
2026-03-27 21:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbc40d71-74f4-5f23-bae5-672a480991f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 119632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbc40d71-74f4-5f23-bae5-672a480991f4/dbc40d71-74f4-5f23-bae5-672a480991f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rw-/6fd8b709c33e4bf7976ce8fed87f8dba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'COOL&CONNECT Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. COOL&CONNECT '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987790%27 HTTP/1.1" 200 None
2026-03-27 21:47:57 [ayvens.de] INFO: Saving data for 1987790: {'created_time': 1774648077.923844, 'last_price_update_time': 1774648077.923855, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987790') HTTP/1.1" 204 0
2026-03-27 21:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-27 21:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789
2026-03-27 21:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8fb06ed8-bbf9-507e-90ef-0846b8eca4e9 with identifier: 1987789 to the API
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fb06ed8-bbf9-507e-90ef-0846b8eca4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 112803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb06ed8-bbf9-507e-90ef-0846b8eca4e9/8fb06ed8-bbf9-507e-90ef-0846b8eca4e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/36e835406aed41539e0710dab85ad243/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System '
          'COOL&CONNECT Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System COOL&CONNECT '
         'Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987789%27 HTTP/1.1" 200 None
2026-03-27 21:47:58 [ayvens.de] INFO: Saving data for 1987789: {'created_time': 1774648078.548224, 'last_price_update_time': 1774648078.548238, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987789') HTTP/1.1" 204 0
2026-03-27 21:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-27 21:47:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788
2026-03-27 21:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11eb9a57-536b-59ae-a3f4-dc61ae7566c9 with identifier: 1987788 to the API
2026-03-27 21:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Metropolis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '11eb9a57-536b-59ae-a3f4-dc61ae7566c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 80530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11eb9a57-536b-59ae-a3f4-dc61ae7566c9/11eb9a57-536b-59ae-a3f4-dc61ae7566c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hn-/ee619e6d8d3a4216bb8a1b3353ecfb02/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ST-LINE Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ST-LINE '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987788%27 HTTP/1.1" 200 None
2026-03-27 21:47:59 [ayvens.de] INFO: Saving data for 1987788: {'created_time': 1774648079.504567, 'last_price_update_time': 1774648079.504577, 'auction_closing_time': 1774875600.0}
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987788') HTTP/1.1" 204 0
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5322810>
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/7.jpg saved to cache
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6dfb910>
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/4.jpg saved to cache
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b8cd50>
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/8.jpg saved to cache
2026-03-27 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d60d10>
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/10.jpg saved to cache
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d61a90>
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/5.jpg saved to cache
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6482950>
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F2bfa0c9dd4fe4d06943deea9a09fbee2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/9.jpg saved to cache
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7
2026-03-27 21:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23da542c-9ccf-5b25-951c-f9c7499dd8a7, skipping ID generation
2026-03-27 21:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with scrape type 1
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23da542c-9ccf-5b25-951c-f9c7499dd8a7 sending to next pipeline
2026-03-27 21:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 23da542c-9ccf-5b25-951c-f9c7499dd8a7, identifier: 1987783
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee9fc25d0>
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Fb8f8e15b3d554685b01bec284767ee73%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/8.jpg saved to cache
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-27 21:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, skipping ID generation
2026-03-27 21:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 sending to next pipeline
2026-03-27 21:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, identifier: 1987784
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6def250>
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252Fab6727681f8c4e1bac1ec46da529009f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/9.jpg saved to cache
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-27 21:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 601aefa2-34f9-5f82-b859-a7a20821655f, skipping ID generation
2026-03-27 21:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 1
2026-03-27 21:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 601aefa2-34f9-5f82-b859-a7a20821655f sending to next pipeline
2026-03-27 21:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 601aefa2-34f9-5f82-b859-a7a20821655f, identifier: 1987786
2026-03-27 21:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-27 21:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783
2026-03-27 21:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 23da542c-9ccf-5b25-951c-f9c7499dd8a7 with identifier: 1987783 to the API
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Braun',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '23da542c-9ccf-5b25-951c-f9c7499dd8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Defender',
 'odometer': 84688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 974494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 925741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 911843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 978821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23da542c-9ccf-5b25-951c-f9c7499dd8a7/23da542c-9ccf-5b25-951c-f9c7499dd8a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/2bfa0c9dd4fe4d06943deea9a09fbee2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Defender LAND ROVER Defender 110 P400e X-Dynamic HSE '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Defender 110 P400e X-Dynamic HSE Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987783%27 HTTP/1.1" 200 None
2026-03-27 21:48:01 [ayvens.de] INFO: Saving data for 1987783: {'created_time': 1774648081.0754, 'last_price_update_time': 1774648081.075411, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987783') HTTP/1.1" 204 0
2026-03-27 21:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-27 21:48:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784
2026-03-27 21:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1987784 to the API
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '4.4L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eeff5ae-b901-5eac-a750-7d7ed9e326e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/b8f8e15b3d554685b01bec284767ee73/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover LAND ROVER Range Rover 4.4 SDV8 Vogue '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover 4.4 SDV8 Vogue Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987784%27 HTTP/1.1" 200 None
2026-03-27 21:48:01 [ayvens.de] INFO: Saving data for 1987784: {'created_time': 1774648081.449529, 'last_price_update_time': 1774648081.449539, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987784') HTTP/1.1" 204 0
2026-03-27 21:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-27 21:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786
2026-03-27 21:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1987786 to the API
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '601aefa2-34f9-5f82-b859-a7a20821655f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 90928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/ab6727681f8c4e1bac1ec46da529009f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'TITANIUM Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. TITANIUM '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987786%27 HTTP/1.1" 200 None
2026-03-27 21:48:02 [ayvens.de] INFO: Saving data for 1987786: {'created_time': 1774648082.06987, 'last_price_update_time': 1774648082.069881, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987786') HTTP/1.1" 204 0
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6c93610>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/4.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee696af10>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/1.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6f0c890>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/3.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee5233b50>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/3.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee52e3490>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/2.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6eeaf50>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/1.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee69717d0>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3824c3b48b024cc6a10c34d1bf0ea6a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/4.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-27 21:48:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a42d01-bd07-5f99-a038-a43f584794fa, skipping ID generation
2026-03-27 21:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a42d01-bd07-5f99-a038-a43f584794fa sending to next pipeline
2026-03-27 21:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 67a42d01-bd07-5f99-a038-a43f584794fa, identifier: 1987781
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee882cf90>
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F3b87c4ab9b9946d5b5d20026ca19857b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/2.jpg saved to cache
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-27 21:48:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d72b9397-852a-5550-89f5-edd56a131f9a, skipping ID generation
2026-03-27 21:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-27 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d72b9397-852a-5550-89f5-edd56a131f9a sending to next pipeline
2026-03-27 21:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d72b9397-852a-5550-89f5-edd56a131f9a, identifier: 1987782
2026-03-27 21:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-27 21:48:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 21:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781
2026-03-27 21:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1987781 to the API
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '67a42d01-bd07-5f99-a038-a43f584794fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 120756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3824c3b48b024cc6a10c34d1bf0ea6a1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 1.4 eHybrid OPF DSG '
          'R-Line Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 1.4 eHybrid OPF DSG R-Line Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987781%27 HTTP/1.1" 200 None
2026-03-27 21:48:03 [ayvens.de] INFO: Saving data for 1987781: {'created_time': 1774648083.387665, 'last_price_update_time': 1774648083.387675, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987781') HTTP/1.1" 204 0
2026-03-27 21:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-27 21:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782
2026-03-27 21:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1987782 to the API
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd72b9397-852a-5550-89f5-edd56a131f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 64253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/3b87c4ab9b9946d5b5d20026ca19857b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport P300e '
          'R-Dynamic S Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport P300e R-Dynamic S Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987782%27 HTTP/1.1" 200 None
2026-03-27 21:48:03 [ayvens.de] INFO: Saving data for 1987782: {'created_time': 1774648083.717738, 'last_price_update_time': 1774648083.717748, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987782') HTTP/1.1" 204 0
2026-03-27 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d566d0>
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/9.jpg saved to cache
2026-03-27 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6d55350>
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/10.jpg saved to cache
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6a93f50>
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/8.jpg saved to cache
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcee6b64b10>
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhk-%252Feb5c4252a27b41e9a877eed98b2020da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/7.jpg saved to cache
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac
2026-03-27 21:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac, skipping ID generation
2026-03-27 21:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with scrape type 1
2026-03-27 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca7d7f96-98ba-53e1-81d8-44e2f0b093ac sending to next pipeline
2026-03-27 21:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac, identifier: 1987780
2026-03-27 21:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-27 21:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780
2026-03-27 21:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ca7d7f96-98ba-53e1-81d8-44e2f0b093ac with identifier: 1987780 to the API
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 21:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'ca7d7f96-98ba-53e1-81d8-44e2f0b093ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41111',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 180623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca7d7f96-98ba-53e1-81d8-44e2f0b093ac/ca7d7f96-98ba-53e1-81d8-44e2f0b093ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hk-/eb5c4252a27b41e9a877eed98b2020da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271987780%27 HTTP/1.1" 200 None
2026-03-27 21:48:04 [ayvens.de] INFO: Saving data for 1987780: {'created_time': 1774648084.687041, 'last_price_update_time': 1774648084.687054, 'auction_closing_time': 1774875600.0}
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1987780') HTTP/1.1" 204 0
2026-03-27 21:48:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 21:48:04 [ayvens.de] INFO: ayvens.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 2, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20last_price_update_time%20lt%201774216084 HTTP/1.1" 200 None
2026-03-27 21:48:04 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (89 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.de/task_43_2026-03-27T21_45_00.jl
2026-03-27 21:48:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 414829,
 'downloader/request_count': 893,
 'downloader/request_method_count/GET': 891,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 636362246,
 'downloader/response_count': 893,
 'downloader/response_status_count/200': 893,
 'elapsed_time_seconds': 178.355423,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 21, 48, 4, 824856, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 89,
 'log_count/DEBUG': 7445,
 'log_count/INFO': 7486,
 'memusage/max': 195239936,
 'memusage/startup': 150024192,
 'photo_download_count': 890,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 131,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 127,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 2,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 25,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 115,
 'playwright/response_count/method/GET': 112,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 2,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 10,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 893,
 'scheduler/dequeued/memory': 893,
 'scheduler/enqueued': 893,
 'scheduler/enqueued/memory': 893,
 'scrape_type/new': 89,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 2,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.8780654836446047,
 'scrapy-zyte-api/mean_response_seconds': 2.9423396959900856,
 'scrapy-zyte-api/processed': 2,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/url': 2,
 'scrapy-zyte-api/status_codes/200': 2,
 'scrapy-zyte-api/success': 2,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 27, 21, 45, 6, 469433, tzinfo=datetime.timezone.utc)}
2026-03-27 21:48:04 [scrapy.core.engine] INFO: Spider closed (finished)