2026-03-26 21:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 21:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 21:45:05 [ayvens.de] INFO: Starting spider ayvens.de
2026-03-26 21:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 21:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 21:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 21:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 21:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: d92609ffbd2c8c93
2026-03-26 21:45:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 21:45:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.de/task_43_2026-03-26T21_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 21:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 21:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 21:45:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 21:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-26 21:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 21:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-26 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 21:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 21:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-26 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-26 21:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-26 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-26 21:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-26 21:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-26 21:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-26 21:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 21:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 21:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-26 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 21:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-26 21:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-26 21:45:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-26 21:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-26 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-26 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-26 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 21:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:17 [ayvens.de] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'NqQJRGYnl/rujna3PPj7l2|2026-03-26T21:45:15.668Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806097515, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'CEUmt5ONq63m2LpxyKlnbs|1774561517052|1774561517052', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774563317, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-26 21:45:17 [ayvens.de] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'NqQJRGYnl/rujna3PPj7l2|2026-03-26T21:45:15.668Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'CEUmt5ONq63m2LpxyKlnbs|1774561517052|1774561517052', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-26 21:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-26 21:45:17 [ayvens.de] INFO: Intercepting token...
2026-03-26 21:45:17 [ayvens.de] INFO: Scrolling element to trigger lazy load...
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-26 21:45:17 [ayvens.de] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/reset.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/reset.svg>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/it.svg>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://medias-carmarket.ayvens.com/lots/ald/gv8/5d3db795f6484cefafe5e3bbf2b2b788/images/medium/0.jpg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-26 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-26 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://medias-carmarket.ayvens.com/lots/ald/gh2/d1e0231afadc4f2592fd6e0e6932e229/images/medium/0.jpg>
2026-03-26 21:45:19 [ayvens.de] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-26 21:45:19 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-26 21:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch)
2026-03-26 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 21:45:22 [ayvens.de] INFO: Found listing with ID: 1985047
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985047%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [ayvens.de] INFO: Scrape type for 1985047: 1
2026-03-26 21:45:22 [ayvens.de] INFO: Extracting data for car ID: 1985047
2026-03-26 21:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with identifier: 1985047
2026-03-26 21:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with scrape type 1
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/1.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/2.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/3.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/4.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/5.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/6.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/7.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/8.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/9.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/10.jpg not downloaded yet
2026-03-26 21:45:22 [ayvens.de] INFO: Found listing with ID: 1985048
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985048%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [ayvens.de] INFO: Scrape type for 1985048: 1
2026-03-26 21:45:22 [ayvens.de] INFO: Extracting data for car ID: 1985048
2026-03-26 21:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1985048
2026-03-26 21:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 1
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/1.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/2.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/3.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/4.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/5.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/6.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/7.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/8.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/9.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/10.jpg not downloaded yet
2026-03-26 21:45:22 [ayvens.de] INFO: Found listing with ID: 1985049
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985049%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [ayvens.de] INFO: Scrape type for 1985049: 1
2026-03-26 21:45:22 [ayvens.de] INFO: Extracting data for car ID: 1985049
2026-03-26 21:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1985049
2026-03-26 21:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/1.jpg not downloaded yet
2026-03-26 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/2.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/3.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/4.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/5.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/6.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/7.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/8.jpg not downloaded yet
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/9.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/10.jpg not downloaded yet
2026-03-26 21:45:23 [ayvens.de] INFO: Found listing with ID: 1985050
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985050%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [ayvens.de] INFO: Scrape type for 1985050: 1
2026-03-26 21:45:23 [ayvens.de] INFO: Extracting data for car ID: 1985050
2026-03-26 21:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1985050
2026-03-26 21:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/1.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/2.jpg not downloaded yet
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/3.jpg not downloaded yet
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c26d0>
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/7.jpg saved to cache
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f1790>
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/8.jpg saved to cache
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/4.jpg not downloaded yet
2026-03-26 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/5.jpg not downloaded yet
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/6.jpg not downloaded yet
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f602650>
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/4.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6f0fd0>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/2.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6cfd90>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/1.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/7.jpg not downloaded yet
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6cefd0>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/3.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/8.jpg not downloaded yet
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/9.jpg not downloaded yet
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f725350>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/9.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6e9590>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/5.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/10.jpg not downloaded yet
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [ayvens.de] INFO: Found listing with ID: 1985051
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985051%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [ayvens.de] INFO: Scrape type for 1985051: 1
2026-03-26 21:45:24 [ayvens.de] INFO: Extracting data for car ID: 1985051
2026-03-26 21:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1985051
2026-03-26 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/1.jpg not downloaded yet
2026-03-26 21:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a3b90>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/6.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6cdb10>
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fol-%252F2f53cdd44e8a4ac88cf4ff1f9b7ee362%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/10.jpg saved to cache
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956
2026-03-26 21:45:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90090fed-3c4c-5da3-aa9b-790f1bcfb956, skipping ID generation
2026-03-26 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with scrape type 1
2026-03-26 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90090fed-3c4c-5da3-aa9b-790f1bcfb956 sending to next pipeline
2026-03-26 21:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 90090fed-3c4c-5da3-aa9b-790f1bcfb956, identifier: 1985047
2026-03-26 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/2.jpg not downloaded yet
2026-03-26 21:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with identifier: 1985047
2026-03-26 21:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with identifier: 1985047
2026-03-26 21:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 90090fed-3c4c-5da3-aa9b-790f1bcfb956 with identifier: 1985047 to the API
2026-03-26 21:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '90090fed-3c4c-5da3-aa9b-790f1bcfb956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Explorer',
 'odometer': 89321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 821238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90090fed-3c4c-5da3-aa9b-790f1bcfb956/90090fed-3c4c-5da3-aa9b-790f1bcfb956_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ol-/2f53cdd44e8a4ac88cf4ff1f9b7ee362/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Explorer FORD Explorer EcoBoost Plug-in Hybrid PLATINUM '
          'Geschlossen, 5-türig, Automatik, 10-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Explorer EcoBoost Plug-in Hybrid PLATINUM Geschlossen, 5-türig, '
         'Automatik, 10-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985047%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [ayvens.de] INFO: Saving data for 1985047: {'created_time': 1774561526.47175, 'last_price_update_time': 1774561526.471759, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985047') HTTP/1.1" 204 0
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/3.jpg not downloaded yet
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/4.jpg not downloaded yet
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f1f90>
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/2.jpg saved to cache
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2e1d10>
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/1.jpg saved to cache
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7cdfd0>
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/4.jpg saved to cache
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d690390>
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/3.jpg saved to cache
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/5.jpg not downloaded yet
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/6.jpg not downloaded yet
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/7.jpg not downloaded yet
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/8.jpg not downloaded yet
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/9.jpg not downloaded yet
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/10.jpg not downloaded yet
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87b690>
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/5.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f714a10>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/6.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:45:27 [ayvens.de] INFO: Found listing with ID: 1985052
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985052%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [ayvens.de] INFO: Scrape type for 1985052: 1
2026-03-26 21:45:27 [ayvens.de] INFO: Extracting data for car ID: 1985052
2026-03-26 21:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1985052
2026-03-26 21:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/1.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/2.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/3.jpg not downloaded yet
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f0090>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/7.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9596d0>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/6.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d925290>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/2.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d95b250>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/1.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8ee110>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/4.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d926650>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/10.jpg saved to cache
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/4.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/5.jpg not downloaded yet
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/6.jpg not downloaded yet
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/7.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/8.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/9.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/10.jpg not downloaded yet
2026-03-26 21:45:27 [ayvens.de] INFO: Found listing with ID: 1985053
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985053%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [ayvens.de] INFO: Scrape type for 1985053: 1
2026-03-26 21:45:27 [ayvens.de] INFO: Extracting data for car ID: 1985053
2026-03-26 21:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1985053
2026-03-26 21:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/1.jpg not downloaded yet
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/2.jpg not downloaded yet
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daef810>
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/8.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f7050>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/10.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1e310>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/7.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1e710>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/9.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9eb110>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/3.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ead10>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/6.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86fbd0>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/9.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9c3450>
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F296f8d48e1704ebd9485bdcfe7aa38ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/5.jpg saved to cache
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-26 21:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e731dd25-76e8-5724-931b-52a262f9cb61, skipping ID generation
2026-03-26 21:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e731dd25-76e8-5724-931b-52a262f9cb61 sending to next pipeline
2026-03-26 21:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e731dd25-76e8-5724-931b-52a262f9cb61, identifier: 1985050
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/3.jpg not downloaded yet
2026-03-26 21:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1985050
2026-03-26 21:45:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1985050
2026-03-26 21:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1985050 to the API
2026-03-26 21:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e731dd25-76e8-5724-931b-52a262f9cb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 80099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/296f8d48e1704ebd9485bdcfe7aa38ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985050%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [ayvens.de] INFO: Saving data for 1985050: {'created_time': 1774561529.216668, 'last_price_update_time': 1774561529.216678, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985050') HTTP/1.1" 204 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/4.jpg not downloaded yet
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/5.jpg not downloaded yet
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/6.jpg not downloaded yet
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/7.jpg not downloaded yet
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/8.jpg not downloaded yet
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/9.jpg not downloaded yet
2026-03-26 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/10.jpg not downloaded yet
2026-03-26 21:45:29 [ayvens.de] INFO: Found listing with ID: 1985054
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985054%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [ayvens.de] INFO: Scrape type for 1985054: 1
2026-03-26 21:45:29 [ayvens.de] INFO: Extracting data for car ID: 1985054
2026-03-26 21:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1985054
2026-03-26 21:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/1.jpg not downloaded yet
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbef10>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/4.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac2a50>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/5.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/2.jpg not downloaded yet
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d860ed0>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/1.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c6890>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/3.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75f4d0>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/2.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c5d50>
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/6.jpg saved to cache
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/3.jpg not downloaded yet
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/4.jpg not downloaded yet
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddddd10>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/10.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7bfd90>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/1.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/5.jpg not downloaded yet
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/6.jpg not downloaded yet
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/7.jpg not downloaded yet
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/8.jpg not downloaded yet
2026-03-26 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/9.jpg not downloaded yet
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/10.jpg not downloaded yet
2026-03-26 21:45:30 [ayvens.de] INFO: Found listing with ID: 1985055
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985055%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [ayvens.de] INFO: Scrape type for 1985055: 1
2026-03-26 21:45:30 [ayvens.de] INFO: Extracting data for car ID: 1985055
2026-03-26 21:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3118b1c0-eac8-586b-9a33-78402db5205f with identifier: 1985055
2026-03-26 21:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3118b1c0-eac8-586b-9a33-78402db5205f with scrape type 1
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/1.jpg not downloaded yet
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/2.jpg not downloaded yet
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f774510>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/3.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8fdb50>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/5.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddde6d0>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/2.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f735150>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/1.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6ea390>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/8.jpg saved to cache
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/3.jpg not downloaded yet
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d959e50>
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/10.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2e0650>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/9.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f729090>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/4.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/4.jpg not downloaded yet
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/5.jpg not downloaded yet
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/6.jpg not downloaded yet
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/7.jpg not downloaded yet
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/8.jpg not downloaded yet
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/9.jpg not downloaded yet
2026-03-26 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/10.jpg not downloaded yet
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9102d0>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/4.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:31 [ayvens.de] INFO: Found listing with ID: 1985056
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985056%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [ayvens.de] INFO: Scrape type for 1985056: 1
2026-03-26 21:45:31 [ayvens.de] INFO: Extracting data for car ID: 1985056
2026-03-26 21:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1985056
2026-03-26 21:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 1
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/1.jpg not downloaded yet
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/2.jpg not downloaded yet
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/3.jpg not downloaded yet
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f728810>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/6.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f732c10>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/5.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a5910>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/2.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7fe790>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/7.jpg saved to cache
2026-03-26 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a76d0>
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/3.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a7b10>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/6.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f716190>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/1.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/4.jpg not downloaded yet
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/5.jpg not downloaded yet
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/6.jpg not downloaded yet
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/7.jpg not downloaded yet
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/8.jpg not downloaded yet
2026-03-26 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/9.jpg not downloaded yet
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/10.jpg not downloaded yet
2026-03-26 21:45:32 [ayvens.de] INFO: Found listing with ID: 1985057
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985057%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [ayvens.de] INFO: Scrape type for 1985057: 1
2026-03-26 21:45:32 [ayvens.de] INFO: Extracting data for car ID: 1985057
2026-03-26 21:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d280347e-f451-538e-a7b7-303054cbad86 with identifier: 1985057
2026-03-26 21:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d280347e-f451-538e-a7b7-303054cbad86 with scrape type 1
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/1.jpg not downloaded yet
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/2.jpg not downloaded yet
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d879cd0>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/3.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d868310>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/1.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a19d0>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/2.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a0e90>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/9.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c6ed0>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/8.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9123d0>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/6.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8680d0>
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/10.jpg saved to cache
2026-03-26 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/3.jpg not downloaded yet
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d88a790>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/5.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/4.jpg not downloaded yet
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/5.jpg not downloaded yet
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/6.jpg not downloaded yet
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/7.jpg not downloaded yet
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/8.jpg not downloaded yet
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/9.jpg not downloaded yet
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/10.jpg not downloaded yet
2026-03-26 21:45:33 [ayvens.de] INFO: Found listing with ID: 1985058
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985058%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [ayvens.de] INFO: Scrape type for 1985058: 1
2026-03-26 21:45:33 [ayvens.de] INFO: Extracting data for car ID: 1985058
2026-03-26 21:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c825ac74-5ed9-526b-8583-6b8f95739447 with identifier: 1985058
2026-03-26 21:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c825ac74-5ed9-526b-8583-6b8f95739447 with scrape type 1
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/1.jpg not downloaded yet
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d166810>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/7.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da8db90>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/4.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f15d0>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/4.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/2.jpg not downloaded yet
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f7c5cd0>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/6.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d142610>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/5.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f742310>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/7.jpg saved to cache
2026-03-26 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8652d0>
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/3.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbf410>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/2.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/3.jpg not downloaded yet
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/4.jpg not downloaded yet
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/5.jpg not downloaded yet
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/6.jpg not downloaded yet
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/7.jpg not downloaded yet
2026-03-26 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/8.jpg not downloaded yet
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/9.jpg not downloaded yet
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/10.jpg not downloaded yet
2026-03-26 21:45:34 [ayvens.de] INFO: Found listing with ID: 1985059
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985059%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [ayvens.de] INFO: Scrape type for 1985059: 1
2026-03-26 21:45:34 [ayvens.de] INFO: Extracting data for car ID: 1985059
2026-03-26 21:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with identifier: 1985059
2026-03-26 21:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with scrape type 1
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/1.jpg not downloaded yet
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8ed4d0>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/1.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87c190>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/3.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f742490>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/10.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87c610>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/5.jpg saved to cache
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/2.jpg not downloaded yet
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17bb50>
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/8.jpg saved to cache
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da3af50>
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fffd2cf506dad43119d883e5566abf8dc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/9.jpg saved to cache
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3118b1c0-eac8-586b-9a33-78402db5205f
2026-03-26 21:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3118b1c0-eac8-586b-9a33-78402db5205f, skipping ID generation
2026-03-26 21:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3118b1c0-eac8-586b-9a33-78402db5205f with scrape type 1
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3118b1c0-eac8-586b-9a33-78402db5205f sending to next pipeline
2026-03-26 21:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3118b1c0-eac8-586b-9a33-78402db5205f, identifier: 1985055
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da71890>
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/6.jpg saved to cache
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ebed0>
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/2.jpg saved to cache
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/3.jpg not downloaded yet
2026-03-26 21:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3118b1c0-eac8-586b-9a33-78402db5205f with identifier: 1985055
2026-03-26 21:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3118b1c0-eac8-586b-9a33-78402db5205f with identifier: 1985055
2026-03-26 21:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3118b1c0-eac8-586b-9a33-78402db5205f with identifier: 1985055 to the API
2026-03-26 21:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '3118b1c0-eac8-586b-9a33-78402db5205f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 45929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3118b1c0-eac8-586b-9a33-78402db5205f/3118b1c0-eac8-586b-9a33-78402db5205f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ffd2cf506dad43119d883e5566abf8dc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI KONA EV Trend Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI KONA EV Trend Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985055%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [ayvens.de] INFO: Saving data for 1985055: {'created_time': 1774561536.236106, 'last_price_update_time': 1774561536.236117, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985055') HTTP/1.1" 204 0
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/4.jpg not downloaded yet
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/5.jpg not downloaded yet
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/6.jpg not downloaded yet
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/7.jpg not downloaded yet
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/8.jpg not downloaded yet
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/9.jpg not downloaded yet
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/10.jpg not downloaded yet
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b3150>
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/4.jpg saved to cache
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da94350>
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/1.jpg saved to cache
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:36 [ayvens.de] INFO: Found listing with ID: 1985060
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985060%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [ayvens.de] INFO: Scrape type for 1985060: 1
2026-03-26 21:45:36 [ayvens.de] INFO: Extracting data for car ID: 1985060
2026-03-26 21:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with identifier: 1985060
2026-03-26 21:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with scrape type 1
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/1.jpg not downloaded yet
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/2.jpg not downloaded yet
2026-03-26 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/3.jpg not downloaded yet
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac3d90>
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/5.jpg saved to cache
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d961f90>
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/10.jpg saved to cache
2026-03-26 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17ded0>
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/2.jpg saved to cache
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d150810>
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/8.jpg saved to cache
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17e590>
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/9.jpg saved to cache
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d85bd90>
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbot%252F834536e032e945238203a7a116338c74%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/7.jpg saved to cache
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1113849-b627-5942-8c72-b9129bb2ed46
2026-03-26 21:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1113849-b627-5942-8c72-b9129bb2ed46, skipping ID generation
2026-03-26 21:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1113849-b627-5942-8c72-b9129bb2ed46 with scrape type 1
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1113849-b627-5942-8c72-b9129bb2ed46 sending to next pipeline
2026-03-26 21:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d1113849-b627-5942-8c72-b9129bb2ed46, identifier: 1985056
2026-03-26 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1985056
2026-03-26 21:45:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1985056
2026-03-26 21:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d1113849-b627-5942-8c72-b9129bb2ed46 with identifier: 1985056 to the API
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'd1113849-b627-5942-8c72-b9129bb2ed46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 153804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1113849-b627-5942-8c72-b9129bb2ed46/d1113849-b627-5942-8c72-b9129bb2ed46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bot/834536e032e945238203a7a116338c74/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.5 T-GDI DCT7 OPF Spirit Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985056%27 HTTP/1.1" 200 None
2026-03-26 21:45:37 [ayvens.de] INFO: Saving data for 1985056: {'created_time': 1774561537.804502, 'last_price_update_time': 1774561537.804514, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985056') HTTP/1.1" 204 0
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/4.jpg not downloaded yet
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/5.jpg not downloaded yet
2026-03-26 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7bef10>
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/4.jpg saved to cache
2026-03-26 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d927d50>
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/3.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/6.jpg not downloaded yet
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/7.jpg not downloaded yet
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1d30d0>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/10.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7fdc90>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/1.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/8.jpg not downloaded yet
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/9.jpg not downloaded yet
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d874b90>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/2.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da392d0>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/1.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d19f690>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/10.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/10.jpg not downloaded yet
2026-03-26 21:45:38 [ayvens.de] INFO: Found listing with ID: 1985061
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985061%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [ayvens.de] INFO: Scrape type for 1985061: 1
2026-03-26 21:45:38 [ayvens.de] INFO: Extracting data for car ID: 1985061
2026-03-26 21:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6292ecc9-759a-50af-bc0f-b019f8430b20 with identifier: 1985061
2026-03-26 21:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6292ecc9-759a-50af-bc0f-b019f8430b20 with scrape type 1
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/1.jpg not downloaded yet
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/2.jpg not downloaded yet
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f775190>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/5.jpg saved to cache
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/3.jpg not downloaded yet
2026-03-26 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/4.jpg not downloaded yet
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a0e50>
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/3.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f713d10>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/9.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/5.jpg not downloaded yet
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/6.jpg not downloaded yet
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/7.jpg not downloaded yet
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80fe10>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/4.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f72bed0>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/5.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/8.jpg not downloaded yet
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/9.jpg not downloaded yet
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1e4d0>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/8.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad2210>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/6.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c3890>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/7.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87a250>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/1.jpg saved to cache
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/10.jpg not downloaded yet
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:39 [ayvens.de] INFO: Found listing with ID: 1985062
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985062%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [ayvens.de] INFO: Scrape type for 1985062: 1
2026-03-26 21:45:39 [ayvens.de] INFO: Extracting data for car ID: 1985062
2026-03-26 21:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e973b4f-1557-52ca-a594-7ed9dce31862 with identifier: 1985062
2026-03-26 21:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e973b4f-1557-52ca-a594-7ed9dce31862 with scrape type 1
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/1.jpg not downloaded yet
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/2.jpg not downloaded yet
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5d7250>
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/2.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/3.jpg not downloaded yet
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/4.jpg not downloaded yet
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7b8150>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/4.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d876150>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/3.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d184090>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/10.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/5.jpg not downloaded yet
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/6.jpg not downloaded yet
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/7.jpg not downloaded yet
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d963bd0>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/6.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc82c90>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/5.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7fffd0>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/9.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/8.jpg not downloaded yet
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/9.jpg not downloaded yet
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2edf10>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/7.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7faf90>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/9.jpg saved to cache
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/19696e35033540519e190e13a506589c/images/large/10.jpg not downloaded yet
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [ayvens.de] INFO: Found listing with ID: 1985063
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985063%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [ayvens.de] INFO: Scrape type for 1985063: 1
2026-03-26 21:45:40 [ayvens.de] INFO: Extracting data for car ID: 1985063
2026-03-26 21:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1985063
2026-03-26 21:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/1.jpg not downloaded yet
2026-03-26 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/2.jpg not downloaded yet
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c1850>
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/2.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f742590>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/10.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8be450>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/1.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/3.jpg not downloaded yet
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/4.jpg not downloaded yet
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87bf10>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/3.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da70390>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/4.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad3e90>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/5.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/5.jpg not downloaded yet
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/6.jpg not downloaded yet
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/7.jpg not downloaded yet
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da73050>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/6.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db00a90>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/7.jpg saved to cache
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/8.jpg not downloaded yet
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6dd410>
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/10.jpg saved to cache
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/9.jpg not downloaded yet
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ea250>
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/9.jpg saved to cache
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5d5350>
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmh-%252Fbd85911042514cf8b12fd4d5b53ba075%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/8.jpg saved to cache
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6292ecc9-759a-50af-bc0f-b019f8430b20
2026-03-26 21:45:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6292ecc9-759a-50af-bc0f-b019f8430b20, skipping ID generation
2026-03-26 21:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6292ecc9-759a-50af-bc0f-b019f8430b20 with scrape type 1
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6292ecc9-759a-50af-bc0f-b019f8430b20 sending to next pipeline
2026-03-26 21:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6292ecc9-759a-50af-bc0f-b019f8430b20, identifier: 1985061
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f6eefd0>
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/2.jpg saved to cache
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/10.jpg not downloaded yet
2026-03-26 21:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6292ecc9-759a-50af-bc0f-b019f8430b20 with identifier: 1985061
2026-03-26 21:45:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6292ecc9-759a-50af-bc0f-b019f8430b20 with identifier: 1985061
2026-03-26 21:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6292ecc9-759a-50af-bc0f-b019f8430b20 with identifier: 1985061 to the API
2026-03-26 21:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '6292ecc9-759a-50af-bc0f-b019f8430b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 37252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6292ecc9-759a-50af-bc0f-b019f8430b20/6292ecc9-759a-50af-bc0f-b019f8430b20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/mh-/bd85911042514cf8b12fd4d5b53ba075/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985061%27 HTTP/1.1" 200 None
2026-03-26 21:45:43 [ayvens.de] INFO: Saving data for 1985061: {'created_time': 1774561543.185432, 'last_price_update_time': 1774561543.185446, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985061') HTTP/1.1" 204 0
2026-03-26 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:43 [ayvens.de] INFO: Found listing with ID: 1985064
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985064%27 HTTP/1.1" 200 None
2026-03-26 21:45:43 [ayvens.de] INFO: Scrape type for 1985064: 1
2026-03-26 21:45:43 [ayvens.de] INFO: Extracting data for car ID: 1985064
2026-03-26 21:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1985064
2026-03-26 21:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 with scrape type 1
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/1.jpg not downloaded yet
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5e00d0>
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/1.jpg saved to cache
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/2.jpg not downloaded yet
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f73fb10>
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkeh%252F78b54953cd774351af942afec54e4728%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/8.jpg saved to cache
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d
2026-03-26 21:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d, skipping ID generation
2026-03-26 21:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with scrape type 1
2026-03-26 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc95e115-dbb3-5ffb-8d7d-ab734a05c07d sending to next pipeline
2026-03-26 21:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d, identifier: 1985060
2026-03-26 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with identifier: 1985060
2026-03-26 21:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with identifier: 1985060
2026-03-26 21:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fc95e115-dbb3-5ffb-8d7d-ab734a05c07d with identifier: 1985060 to the API
2026-03-26 21:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'fc95e115-dbb3-5ffb-8d7d-ab734a05c07d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 23644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc95e115-dbb3-5ffb-8d7d-ab734a05c07d/fc95e115-dbb3-5ffb-8d7d-ab734a05c07d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/keh/78b54953cd774351af942afec54e4728/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio RENAULT Clio TCe 90 EQUILIBRE Limousine, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Clio TCe 90 EQUILIBRE Limousine, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985060%27 HTTP/1.1" 200 None
2026-03-26 21:45:44 [ayvens.de] INFO: Saving data for 1985060: {'created_time': 1774561544.866117, 'last_price_update_time': 1774561544.866128, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985060') HTTP/1.1" 204 0
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/3.jpg not downloaded yet
2026-03-26 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a6a10>
2026-03-26 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/4.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/4.jpg not downloaded yet
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa6290>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/5.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6acf68d50>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/7.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/5.jpg not downloaded yet
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/6.jpg not downloaded yet
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d876750>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/3.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69fbe8b10>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/6.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/7.jpg not downloaded yet
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/8.jpg not downloaded yet
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa6810>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/9.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f714510>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/10.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/9.jpg not downloaded yet
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/10.jpg not downloaded yet
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [ayvens.de] INFO: Found listing with ID: 1985065
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985065%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [ayvens.de] INFO: Scrape type for 1985065: 1
2026-03-26 21:45:45 [ayvens.de] INFO: Extracting data for car ID: 1985065
2026-03-26 21:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1985065
2026-03-26 21:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with scrape type 1
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/1.jpg not downloaded yet
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc81ad0>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/1.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d875590>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/2.jpg saved to cache
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/2.jpg not downloaded yet
2026-03-26 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/3.jpg not downloaded yet
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74b790>
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/4.jpg saved to cache
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a6910>
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F19696e35033540519e190e13a506589c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/8.jpg saved to cache
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e973b4f-1557-52ca-a594-7ed9dce31862
2026-03-26 21:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e973b4f-1557-52ca-a594-7ed9dce31862, skipping ID generation
2026-03-26 21:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e973b4f-1557-52ca-a594-7ed9dce31862 with scrape type 1
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e973b4f-1557-52ca-a594-7ed9dce31862 sending to next pipeline
2026-03-26 21:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0e973b4f-1557-52ca-a594-7ed9dce31862, identifier: 1985062
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d19bdd0>
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/5.jpg saved to cache
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/4.jpg not downloaded yet
2026-03-26 21:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0e973b4f-1557-52ca-a594-7ed9dce31862 with identifier: 1985062
2026-03-26 21:45:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0e973b4f-1557-52ca-a594-7ed9dce31862 with identifier: 1985062
2026-03-26 21:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0e973b4f-1557-52ca-a594-7ed9dce31862 with identifier: 1985062 to the API
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '0e973b4f-1557-52ca-a594-7ed9dce31862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 91540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 927664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e973b4f-1557-52ca-a594-7ed9dce31862/0e973b4f-1557-52ca-a594-7ed9dce31862_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/19696e35033540519e190e13a506589c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 Langstreckenbatt. Allradantrieb Dual '
          'Motor Limousine, 4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 Langstreckenbatt. Allradantrieb Dual Motor Limousine, '
         '4-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985062%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [ayvens.de] INFO: Saving data for 1985062: {'created_time': 1774561546.697581, 'last_price_update_time': 1774561546.697592, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985062') HTTP/1.1" 204 0
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/5.jpg not downloaded yet
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/6.jpg not downloaded yet
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7b8690>
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/6.jpg saved to cache
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/7.jpg not downloaded yet
2026-03-26 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/8.jpg not downloaded yet
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa7cd0>
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/7.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbcb10>
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/9.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da19950>
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/3.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/9.jpg not downloaded yet
2026-03-26 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/10.jpg not downloaded yet
2026-03-26 21:45:47 [ayvens.de] INFO: Found listing with ID: 1985066
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985066%27 HTTP/1.1" 200 None
2026-03-26 21:45:47 [ayvens.de] INFO: Scrape type for 1985066: 1
2026-03-26 21:45:47 [ayvens.de] INFO: Extracting data for car ID: 1985066
2026-03-26 21:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1985066
2026-03-26 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/1.jpg not downloaded yet
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbf6d0>
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/10.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80d790>
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flev%252F7d8cb089e71e4950857c8ca5db62e72c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/8.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6209d459-4198-5691-9aab-360956f8f4d6
2026-03-26 21:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6209d459-4198-5691-9aab-360956f8f4d6, skipping ID generation
2026-03-26 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6209d459-4198-5691-9aab-360956f8f4d6 with scrape type 1
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6209d459-4198-5691-9aab-360956f8f4d6 sending to next pipeline
2026-03-26 21:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6209d459-4198-5691-9aab-360956f8f4d6, identifier: 1985063
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c1e50>
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/1.jpg saved to cache
2026-03-26 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1985063
2026-03-26 21:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1985063
2026-03-26 21:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6209d459-4198-5691-9aab-360956f8f4d6 with identifier: 1985063 to the API
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '6209d459-4198-5691-9aab-360956f8f4d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Vito / Marco Polo',
 'odometer': 107057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6209d459-4198-5691-9aab-360956f8f4d6/6209d459-4198-5691-9aab-360956f8f4d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lev/7d8cb089e71e4950857c8ca5db62e72c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Vito / Marco Polo MERCEDES-BENZ Vito 114 CDI Lang HA '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ Vito 114 CDI Lang HA Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985063%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [ayvens.de] INFO: Saving data for 1985063: {'created_time': 1774561548.120168, 'last_price_update_time': 1774561548.120179, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985063') HTTP/1.1" 204 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/2.jpg not downloaded yet
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/3.jpg not downloaded yet
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74a6d0>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/3.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5d5510>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/2.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/4.jpg not downloaded yet
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/5.jpg not downloaded yet
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f6a77d0>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/4.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc81e50>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/5.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/6.jpg not downloaded yet
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/7.jpg not downloaded yet
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a0b90>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/8.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9e8390>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/8.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad0b50>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/7.jpg saved to cache
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/8.jpg not downloaded yet
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/9.jpg not downloaded yet
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/10.jpg not downloaded yet
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87ad50>
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/6.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74a4d0>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/10.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8bf290>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/1.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [ayvens.de] INFO: Found listing with ID: 1985067
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985067%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [ayvens.de] INFO: Scrape type for 1985067: 1
2026-03-26 21:45:49 [ayvens.de] INFO: Extracting data for car ID: 1985067
2026-03-26 21:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1985067
2026-03-26 21:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with scrape type 1
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/1.jpg not downloaded yet
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/2.jpg not downloaded yet
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f775850>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/2.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d705210>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/3.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/3.jpg not downloaded yet
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/4.jpg not downloaded yet
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/5.jpg not downloaded yet
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d927d50>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/5.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d186b90>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/6.jpg saved to cache
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/6.jpg not downloaded yet
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/7.jpg not downloaded yet
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d868d50>
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/4.jpg saved to cache
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8bd050>
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-r%252F3d157f6a9f5c4d7588539d2fe7a646e8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/9.jpg saved to cache
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa3bcc8d-1ce2-540f-a98f-adac47df2244
2026-03-26 21:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa3bcc8d-1ce2-540f-a98f-adac47df2244, skipping ID generation
2026-03-26 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 with scrape type 1
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa3bcc8d-1ce2-540f-a98f-adac47df2244 sending to next pipeline
2026-03-26 21:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fa3bcc8d-1ce2-540f-a98f-adac47df2244, identifier: 1985064
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74fe50>
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/9.jpg saved to cache
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/8.jpg not downloaded yet
2026-03-26 21:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1985064
2026-03-26 21:45:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1985064
2026-03-26 21:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fa3bcc8d-1ce2-540f-a98f-adac47df2244 with identifier: 1985064 to the API
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'fa3bcc8d-1ce2-540f-a98f-adac47df2244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 173552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3bcc8d-1ce2-540f-a98f-adac47df2244/fa3bcc8d-1ce2-540f-a98f-adac47df2244_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-r/3d157f6a9f5c4d7588539d2fe7a646e8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 AUDI A3 30 TFSI Limousine S tronic Limousine, 4-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A3 30 TFSI Limousine S tronic Limousine, 4-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985064%27 HTTP/1.1" 200 None
2026-03-26 21:45:50 [ayvens.de] INFO: Saving data for 1985064: {'created_time': 1774561550.76688, 'last_price_update_time': 1774561550.766892, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985064') HTTP/1.1" 204 0
2026-03-26 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/9.jpg not downloaded yet
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/10.jpg not downloaded yet
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6acf77610>
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/8.jpg saved to cache
2026-03-26 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9109d0>
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/10.jpg saved to cache
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:51 [ayvens.de] INFO: Found listing with ID: 1985068
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985068%27 HTTP/1.1" 200 None
2026-03-26 21:45:51 [ayvens.de] INFO: Scrape type for 1985068: 1
2026-03-26 21:45:51 [ayvens.de] INFO: Extracting data for car ID: 1985068
2026-03-26 21:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1985068
2026-03-26 21:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/1.jpg not downloaded yet
2026-03-26 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/2.jpg not downloaded yet
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7fac90>
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/1.jpg saved to cache
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f745410>
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/3.jpg saved to cache
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/3.jpg not downloaded yet
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac3f90>
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/4.jpg saved to cache
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74f2d0>
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fea9af74906eb43fd8f1fcaa8ced6ba5c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/7.jpg saved to cache
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef
2026-03-26 21:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef, skipping ID generation
2026-03-26 21:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with scrape type 1
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9d2f660-ccbd-5ba6-95e7-33b20ed27eef sending to next pipeline
2026-03-26 21:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef, identifier: 1985065
2026-03-26 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/4.jpg not downloaded yet
2026-03-26 21:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1985065
2026-03-26 21:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1985065
2026-03-26 21:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c9d2f660-ccbd-5ba6-95e7-33b20ed27eef with identifier: 1985065 to the API
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'c9d2f660-ccbd-5ba6-95e7-33b20ed27eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 166466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d2f660-ccbd-5ba6-95e7-33b20ed27eef/c9d2f660-ccbd-5ba6-95e7-33b20ed27eef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/ea9af74906eb43fd8f1fcaa8ced6ba5c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TFSI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TFSI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985065%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [ayvens.de] INFO: Saving data for 1985065: {'created_time': 1774561552.085761, 'last_price_update_time': 1774561552.085771, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985065') HTTP/1.1" 204 0
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc80a10>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/2.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d875090>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/5.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/5.jpg not downloaded yet
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/6.jpg not downloaded yet
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2e1610>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/6.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/7.jpg not downloaded yet
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/8.jpg not downloaded yet
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c0250>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/8.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7ec6d0>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/10.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/9.jpg not downloaded yet
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/10.jpg not downloaded yet
2026-03-26 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:52 [ayvens.de] INFO: Found listing with ID: 1985069
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985069%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [ayvens.de] INFO: Scrape type for 1985069: 1
2026-03-26 21:45:52 [ayvens.de] INFO: Extracting data for car ID: 1985069
2026-03-26 21:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767299f6-8cca-5f67-b565-c9b9c0a55613 with identifier: 1985069
2026-03-26 21:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767299f6-8cca-5f67-b565-c9b9c0a55613 with scrape type 1
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/1.jpg not downloaded yet
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c3010>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/9.jpg saved to cache
2026-03-26 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8ec910>
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/2.jpg saved to cache
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1fed0>
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/1.jpg saved to cache
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/2.jpg not downloaded yet
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/3.jpg not downloaded yet
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da18f50>
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Faa-%252F0fa17744da374c1383562d6658e6e41c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/7.jpg saved to cache
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da284d19-31cb-5c93-9976-fd28ea9fe5bd
2026-03-26 21:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da284d19-31cb-5c93-9976-fd28ea9fe5bd, skipping ID generation
2026-03-26 21:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da284d19-31cb-5c93-9976-fd28ea9fe5bd with scrape type 1
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da284d19-31cb-5c93-9976-fd28ea9fe5bd sending to next pipeline
2026-03-26 21:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: da284d19-31cb-5c93-9976-fd28ea9fe5bd, identifier: 1985066
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80dfd0>
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/3.jpg saved to cache
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b0a50>
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/5.jpg saved to cache
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/4.jpg not downloaded yet
2026-03-26 21:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1985066
2026-03-26 21:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1985066
2026-03-26 21:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: da284d19-31cb-5c93-9976-fd28ea9fe5bd with identifier: 1985066 to the API
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'da284d19-31cb-5c93-9976-fd28ea9fe5bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 141479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da284d19-31cb-5c93-9976-fd28ea9fe5bd/da284d19-31cb-5c93-9976-fd28ea9fe5bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/aa-/0fa17744da374c1383562d6658e6e41c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A6 Avant 45 TFSI S tronic design Kombi, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985066%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [ayvens.de] INFO: Saving data for 1985066: {'created_time': 1774561553.895947, 'last_price_update_time': 1774561553.895958, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985066') HTTP/1.1" 204 0
2026-03-26 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/5.jpg not downloaded yet
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/6.jpg not downloaded yet
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2efbd0>
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/8.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/7.jpg not downloaded yet
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/8.jpg not downloaded yet
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9e8690>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/6.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c1690>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/7.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/9.jpg not downloaded yet
2026-03-26 21:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/10.jpg not downloaded yet
2026-03-26 21:45:54 [ayvens.de] INFO: Found listing with ID: 1985070
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985070%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [ayvens.de] INFO: Scrape type for 1985070: 1
2026-03-26 21:45:54 [ayvens.de] INFO: Extracting data for car ID: 1985070
2026-03-26 21:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with identifier: 1985070
2026-03-26 21:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with scrape type 1
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/1.jpg not downloaded yet
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d184350>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/10.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6f3590>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/9.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d71a710>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F6f698ffe2842431d9e3134d65b634a9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/4.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1
2026-03-26 21:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1, skipping ID generation
2026-03-26 21:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with scrape type 1
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 sending to next pipeline
2026-03-26 21:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1, identifier: 1985067
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9110d0>
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-e%252F3fa7ddedaea04843bdf6d19328513b78%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/7.jpg saved to cache
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f
2026-03-26 21:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f, skipping ID generation
2026-03-26 21:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with scrape type 1
2026-03-26 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26c7b95f-3738-53f1-9ec6-66377dc4ee3f sending to next pipeline
2026-03-26 21:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f, identifier: 1985059
2026-03-26 21:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1985067
2026-03-26 21:45:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1985067
2026-03-26 21:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1 with identifier: 1985067 to the API
2026-03-26 21:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz Uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3er',
 'odometer': 112854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1/e426efa4-8fa5-5dc7-b56e-5ba06e01dfa1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/6f698ffe2842431d9e3134d65b634a9f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er BMW 320d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 320d Touring Aut. Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985067%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [ayvens.de] INFO: Saving data for 1985067: {'created_time': 1774561555.140843, 'last_price_update_time': 1774561555.140854, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985067') HTTP/1.1" 204 0
2026-03-26 21:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with identifier: 1985059
2026-03-26 21:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with identifier: 1985059
2026-03-26 21:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 26c7b95f-3738-53f1-9ec6-66377dc4ee3f with identifier: 1985059 to the API
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': '26c7b95f-3738-53f1-9ec6-66377dc4ee3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Rio',
 'odometer': 63792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c7b95f-3738-53f1-9ec6-66377dc4ee3f/26c7b95f-3738-53f1-9ec6-66377dc4ee3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-e/3fa7ddedaea04843bdf6d19328513b78/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Rio KIA Rio 1.0 T-GDI 120 Mild-Hybrid DCT7 GT Line Limousine, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Rio 1.0 T-GDI 120 Mild-Hybrid DCT7 GT Line Limousine, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985059%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [ayvens.de] INFO: Saving data for 1985059: {'created_time': 1774561555.592969, 'last_price_update_time': 1774561555.592981, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985059') HTTP/1.1" 204 0
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/2.jpg not downloaded yet
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/3.jpg not downloaded yet
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6fbcd0>
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/3.jpg saved to cache
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/4.jpg not downloaded yet
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/5.jpg not downloaded yet
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6f9250>
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/4.jpg saved to cache
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/6.jpg not downloaded yet
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74c610>
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/5.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/7.jpg not downloaded yet
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d698e50>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/6.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7121d0>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/8.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d89bf90>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/9.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f0f90>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/7.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da39190>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/2.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/8.jpg not downloaded yet
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/9.jpg not downloaded yet
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d95a090>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/10.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/10.jpg not downloaded yet
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [ayvens.de] INFO: Found listing with ID: 1985071
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985071%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [ayvens.de] INFO: Scrape type for 1985071: 1
2026-03-26 21:45:56 [ayvens.de] INFO: Extracting data for car ID: 1985071
2026-03-26 21:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1985071
2026-03-26 21:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 1
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/1.jpg not downloaded yet
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/2.jpg not downloaded yet
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/3.jpg not downloaded yet
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/4.jpg not downloaded yet
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/5.jpg not downloaded yet
2026-03-26 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d959590>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/3.jpg saved to cache
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/6.jpg not downloaded yet
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7efad0>
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/2.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/7.jpg not downloaded yet
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/8.jpg not downloaded yet
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f70e8d0>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/5.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da19fd0>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/4.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a5890>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/6.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da72f50>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsi-%252Fb72c3af0fcb84d7c96d1e982262570b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/1.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2
2026-03-26 21:45:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, skipping ID generation
2026-03-26 21:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with scrape type 1
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 sending to next pipeline
2026-03-26 21:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2, identifier: 1985068
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7b8210>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/1.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f702b50>
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/9.jpg saved to cache
2026-03-26 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1985068
2026-03-26 21:45:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1985068
2026-03-26 21:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 34e4ce32-4ccd-5eaa-8527-6989631e5ff2 with identifier: 1985068 to the API
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': '34e4ce32-4ccd-5eaa-8527-6989631e5ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'DS7',
 'odometer': 159688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e4ce32-4ccd-5eaa-8527-6989631e5ff2/34e4ce32-4ccd-5eaa-8527-6989631e5ff2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/si-/b72c3af0fcb84d7c96d1e982262570b6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN DS7 CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE '
          'LINE + Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'CITROEN DS7 Crossback PureTech 180 Aut. PERFORMANCE LINE + '
         'Geschlossen, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985068%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [ayvens.de] INFO: Saving data for 1985068: {'created_time': 1774561558.248668, 'last_price_update_time': 1774561558.248681, 'auction_closing_time': 1774620000.0}
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985068') HTTP/1.1" 204 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/9.jpg not downloaded yet
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/09f1125d76ad41a792b68ecededf9c50/images/large/10.jpg not downloaded yet
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [ayvens.de] INFO: Found listing with ID: 1985072
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985072%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [ayvens.de] INFO: Scrape type for 1985072: 1
2026-03-26 21:45:58 [ayvens.de] INFO: Extracting data for car ID: 1985072
2026-03-26 21:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1985072
2026-03-26 21:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 1
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/1.jpg not downloaded yet
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/2.jpg not downloaded yet
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/3.jpg not downloaded yet
2026-03-26 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/4.jpg not downloaded yet
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/5.jpg not downloaded yet
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/6.jpg not downloaded yet
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6fb7d0>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/1.jpg saved to cache
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dda2810>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/2.jpg saved to cache
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c3b90>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/3.jpg saved to cache
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1431d0>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/5.jpg saved to cache
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/7.jpg not downloaded yet
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c2c10>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/4.jpg saved to cache
2026-03-26 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f765cd0>
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/10.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75ced0>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/7.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbfdd0>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/8.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/8.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/9.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/10.jpg not downloaded yet
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [ayvens.de] INFO: Found listing with ID: 1985073
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985073%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [ayvens.de] INFO: Scrape type for 1985073: 1
2026-03-26 21:45:59 [ayvens.de] INFO: Extracting data for car ID: 1985073
2026-03-26 21:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with identifier: 1985073
2026-03-26 21:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with scrape type 1
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/1.jpg not downloaded yet
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/2.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/3.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/4.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/5.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/6.jpg not downloaded yet
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f70f250>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/9.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da383d0>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/1.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db00d10>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/3.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d868690>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/8.jpg saved to cache
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/7.jpg not downloaded yet
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/8.jpg not downloaded yet
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da38290>
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/7.jpg saved to cache
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad39d0>
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/2.jpg saved to cache
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d687e50>
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/6.jpg saved to cache
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc76f50>
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4a3a9b5fab0d4b0d8cc13f1f3720aba7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/10.jpg saved to cache
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d
2026-03-26 21:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d, skipping ID generation
2026-03-26 21:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with scrape type 1
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae8ed1b4-f937-5e48-aab0-65a61e5efb7d sending to next pipeline
2026-03-26 21:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d, identifier: 1985070
2026-03-26 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/9.jpg not downloaded yet
2026-03-26 21:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with identifier: 1985070
2026-03-26 21:46:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with identifier: 1985070
2026-03-26 21:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ae8ed1b4-f937-5e48-aab0-65a61e5efb7d with identifier: 1985070 to the API
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'ae8ed1b4-f937-5e48-aab0-65a61e5efb7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 34223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8ed1b4-f937-5e48-aab0-65a61e5efb7d/ae8ed1b4-f937-5e48-aab0-65a61e5efb7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4a3a9b5fab0d4b0d8cc13f1f3720aba7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985070%27 HTTP/1.1" 200 None
2026-03-26 21:46:00 [ayvens.de] INFO: Saving data for 1985070: {'created_time': 1774561560.946053, 'last_price_update_time': 1774561560.94607, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985070') HTTP/1.1" 204 0
2026-03-26 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/10.jpg not downloaded yet
2026-03-26 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:00 [ayvens.de] INFO: Found listing with ID: 1985074
2026-03-26 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985074%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [ayvens.de] INFO: Scrape type for 1985074: 1
2026-03-26 21:46:01 [ayvens.de] INFO: Extracting data for car ID: 1985074
2026-03-26 21:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae4ab858-e210-5cda-b979-7136ade3a9a4 with identifier: 1985074
2026-03-26 21:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae4ab858-e210-5cda-b979-7136ade3a9a4 with scrape type 1
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/1.jpg not downloaded yet
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87c050>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/10.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/2.jpg not downloaded yet
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/3.jpg not downloaded yet
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f603950>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/9.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db02e50>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/5.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d868190>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/8.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2ed750>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/4.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/4.jpg not downloaded yet
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/5.jpg not downloaded yet
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/6.jpg not downloaded yet
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc77410>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F09f1125d76ad41a792b68ecededf9c50%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/6.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 601aefa2-34f9-5f82-b859-a7a20821655f
2026-03-26 21:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 601aefa2-34f9-5f82-b859-a7a20821655f, skipping ID generation
2026-03-26 21:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601aefa2-34f9-5f82-b859-a7a20821655f with scrape type 1
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 601aefa2-34f9-5f82-b859-a7a20821655f sending to next pipeline
2026-03-26 21:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 601aefa2-34f9-5f82-b859-a7a20821655f, identifier: 1985071
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2edf90>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/7.jpg saved to cache
2026-03-26 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7b81d0>
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/1.jpg saved to cache
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1985071
2026-03-26 21:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1985071
2026-03-26 21:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 601aefa2-34f9-5f82-b859-a7a20821655f with identifier: 1985071 to the API
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '601aefa2-34f9-5f82-b859-a7a20821655f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 90928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601aefa2-34f9-5f82-b859-a7a20821655f/601aefa2-34f9-5f82-b859-a7a20821655f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/09f1125d76ad41a792b68ecededf9c50/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'TITANIUM Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. TITANIUM '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985071%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [ayvens.de] INFO: Saving data for 1985071: {'created_time': 1774561562.400843, 'last_price_update_time': 1774561562.400853, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985071') HTTP/1.1" 204 0
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/7.jpg not downloaded yet
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/8.jpg not downloaded yet
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/9.jpg not downloaded yet
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/10.jpg not downloaded yet
2026-03-26 21:46:02 [ayvens.de] INFO: Found listing with ID: 1985075
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985075%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [ayvens.de] INFO: Scrape type for 1985075: 1
2026-03-26 21:46:02 [ayvens.de] INFO: Extracting data for car ID: 1985075
2026-03-26 21:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b539b9-9cb3-5332-9a7e-2727222d66f3 with identifier: 1985075
2026-03-26 21:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b539b9-9cb3-5332-9a7e-2727222d66f3 with scrape type 1
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/1.jpg not downloaded yet
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/2.jpg not downloaded yet
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f710310>
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/9.jpg saved to cache
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc13110>
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/10.jpg saved to cache
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/3.jpg not downloaded yet
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/4.jpg not downloaded yet
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/5.jpg not downloaded yet
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa6210>
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/5.jpg saved to cache
2026-03-26 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80c450>
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/8.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f732710>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/6.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f5a50>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/4.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f731b50>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/5.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da71a90>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/6.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/6.jpg not downloaded yet
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/7.jpg not downloaded yet
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/8.jpg not downloaded yet
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/9.jpg not downloaded yet
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/10.jpg not downloaded yet
2026-03-26 21:46:03 [ayvens.de] INFO: Found listing with ID: 1985076
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985076%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [ayvens.de] INFO: Scrape type for 1985076: 1
2026-03-26 21:46:03 [ayvens.de] INFO: Extracting data for car ID: 1985076
2026-03-26 21:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374d39d6-e687-538b-99df-e7f5b3b495fd with identifier: 1985076
2026-03-26 21:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374d39d6-e687-538b-99df-e7f5b3b495fd with scrape type 1
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/1.jpg not downloaded yet
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/2.jpg not downloaded yet
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6fa510>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/8.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d959c50>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/7.jpg saved to cache
2026-03-26 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f743750>
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/4.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/3.jpg not downloaded yet
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f774450>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/10.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f777050>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/3.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/4.jpg not downloaded yet
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/5.jpg not downloaded yet
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d868850>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/2.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d864590>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/9.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6eab90>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/1.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/6.jpg not downloaded yet
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/7.jpg not downloaded yet
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d71ba90>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/6.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/8.jpg not downloaded yet
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/9.jpg not downloaded yet
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d89aad0>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/5.jpg saved to cache
2026-03-26 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d927610>
2026-03-26 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/3.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc75690>
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/2.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f72e550>
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/8.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc76ad0>
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/9.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%C3%B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hös/adda8e2c3cfc4e99b82b681e69c914ca/images/large/10.jpg not downloaded yet
2026-03-26 21:46:05 [ayvens.de] INFO: Found listing with ID: 1985077
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985077%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [ayvens.de] INFO: Scrape type for 1985077: 1
2026-03-26 21:46:05 [ayvens.de] INFO: Extracting data for car ID: 1985077
2026-03-26 21:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec6cd04-ca05-5d98-b409-930668da2d5c with identifier: 1985077
2026-03-26 21:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec6cd04-ca05-5d98-b409-930668da2d5c with scrape type 1
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/1.jpg not downloaded yet
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa5190>
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/10.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75c690>
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/1.jpg saved to cache
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/2.jpg not downloaded yet
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/3.jpg not downloaded yet
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/4.jpg not downloaded yet
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/5.jpg not downloaded yet
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/6.jpg not downloaded yet
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/7.jpg not downloaded yet
2026-03-26 21:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/8.jpg not downloaded yet
2026-03-26 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/9.jpg not downloaded yet
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/10.jpg not downloaded yet
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b2110>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/6.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:06 [ayvens.de] INFO: Found listing with ID: 1985078
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985078%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [ayvens.de] INFO: Scrape type for 1985078: 1
2026-03-26 21:46:06 [ayvens.de] INFO: Extracting data for car ID: 1985078
2026-03-26 21:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c77922-6434-5190-8c82-19756285b05d with identifier: 1985078
2026-03-26 21:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c77922-6434-5190-8c82-19756285b05d with scrape type 1
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/1.jpg not downloaded yet
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f8510>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/2.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1b89d0>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/4.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74fd50>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/3.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/2.jpg not downloaded yet
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/3.jpg not downloaded yet
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daee250>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/1.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d143610>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/5.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7123d0>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/10.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddde590>
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/9.jpg saved to cache
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:06 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 16 items (at 16 items/min)
2026-03-26 21:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/4.jpg not downloaded yet
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/5.jpg not downloaded yet
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/6.jpg not downloaded yet
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/7.jpg not downloaded yet
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/8.jpg not downloaded yet
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/9.jpg not downloaded yet
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/10.jpg not downloaded yet
2026-03-26 21:46:06 [ayvens.de] INFO: Found listing with ID: 1985079
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985079%27 HTTP/1.1" 200 None
2026-03-26 21:46:07 [ayvens.de] INFO: Scrape type for 1985079: 1
2026-03-26 21:46:07 [ayvens.de] INFO: Extracting data for car ID: 1985079
2026-03-26 21:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with identifier: 1985079
2026-03-26 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with scrape type 1
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/1.jpg not downloaded yet
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6dd950>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/7.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/2.jpg not downloaded yet
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d875b50>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/6.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7fc450>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/4.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc809d0>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/9.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18e2d0>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/8.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7246d0>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/8.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f733810>
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F553bbb00686046ae98a63797ca3e72fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/7.jpg saved to cache
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15b539b9-9cb3-5332-9a7e-2727222d66f3
2026-03-26 21:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15b539b9-9cb3-5332-9a7e-2727222d66f3, skipping ID generation
2026-03-26 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b539b9-9cb3-5332-9a7e-2727222d66f3 with scrape type 1
2026-03-26 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15b539b9-9cb3-5332-9a7e-2727222d66f3 sending to next pipeline
2026-03-26 21:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 15b539b9-9cb3-5332-9a7e-2727222d66f3, identifier: 1985075
2026-03-26 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f974990>
2026-03-26 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/5.jpg saved to cache
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/3.jpg not downloaded yet
2026-03-26 21:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 15b539b9-9cb3-5332-9a7e-2727222d66f3 with identifier: 1985075
2026-03-26 21:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 15b539b9-9cb3-5332-9a7e-2727222d66f3 with identifier: 1985075
2026-03-26 21:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 15b539b9-9cb3-5332-9a7e-2727222d66f3 with identifier: 1985075 to the API
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '15b539b9-9cb3-5332-9a7e-2727222d66f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 57240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b539b9-9cb3-5332-9a7e-2727222d66f3/15b539b9-9cb3-5332-9a7e-2727222d66f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/553bbb00686046ae98a63797ca3e72fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985075%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [ayvens.de] INFO: Saving data for 1985075: {'created_time': 1774561568.794501, 'last_price_update_time': 1774561568.794511, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985075') HTTP/1.1" 204 0
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/4.jpg not downloaded yet
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/5.jpg not downloaded yet
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/6.jpg not downloaded yet
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/7.jpg not downloaded yet
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/8.jpg not downloaded yet
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/9.jpg not downloaded yet
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/10.jpg not downloaded yet
2026-03-26 21:46:08 [ayvens.de] INFO: Found listing with ID: 1985080
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985080%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [ayvens.de] INFO: Scrape type for 1985080: 1
2026-03-26 21:46:08 [ayvens.de] INFO: Extracting data for car ID: 1985080
2026-03-26 21:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with identifier: 1985080
2026-03-26 21:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with scrape type 1
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/1.jpg not downloaded yet
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f717f50>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/3.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/2.jpg not downloaded yet
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7a5350>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/2.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6acf76650>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/1.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d869cd0>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/2.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc01f50>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/10.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/3.jpg not downloaded yet
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/4.jpg not downloaded yet
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5e0190>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/1.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8d7a10>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/5.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8fc890>
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/4.jpg saved to cache
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/5.jpg not downloaded yet
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/6.jpg not downloaded yet
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/7.jpg not downloaded yet
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/8.jpg not downloaded yet
2026-03-26 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/9.jpg not downloaded yet
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f711350>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/3.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2e0750>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/4.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%C3%BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rüd/cda691b014e9458cbe71333b3b5f2f8a/images/large/10.jpg not downloaded yet
2026-03-26 21:46:10 [ayvens.de] INFO: Found listing with ID: 1985081
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985081%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [ayvens.de] INFO: Scrape type for 1985081: 1
2026-03-26 21:46:10 [ayvens.de] INFO: Extracting data for car ID: 1985081
2026-03-26 21:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222757f4-4695-5bb3-961f-07cc7ae01a95 with identifier: 1985081
2026-03-26 21:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222757f4-4695-5bb3-961f-07cc7ae01a95 with scrape type 1
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/1.jpg not downloaded yet
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/2.jpg not downloaded yet
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da38990>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/2.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1d2b10>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/9.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8be750>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/10.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc77d50>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/1.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80cd50>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/5.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa4f50>
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/3.jpg saved to cache
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/3.jpg not downloaded yet
2026-03-26 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/4.jpg not downloaded yet
2026-03-26 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/5.jpg not downloaded yet
2026-03-26 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/6.jpg not downloaded yet
2026-03-26 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/7.jpg not downloaded yet
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/8.jpg not downloaded yet
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/9.jpg not downloaded yet
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/10.jpg not downloaded yet
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da5d250>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/4.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:11 [ayvens.de] INFO: Found listing with ID: 1985082
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985082%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [ayvens.de] INFO: Scrape type for 1985082: 1
2026-03-26 21:46:11 [ayvens.de] INFO: Extracting data for car ID: 1985082
2026-03-26 21:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1c686c-e077-5388-9cc7-13fea55fd115 with identifier: 1985082
2026-03-26 21:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1c686c-e077-5388-9cc7-13fea55fd115 with scrape type 1
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/1.jpg not downloaded yet
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc03c10>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/5.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d16eb10>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/10.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9d5fd0>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/8.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/2.jpg not downloaded yet
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/3.jpg not downloaded yet
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8a8510>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/9.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c6750>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/6.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18f410>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/2.jpg saved to cache
2026-03-26 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d85b290>
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/3.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/4.jpg not downloaded yet
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/5.jpg not downloaded yet
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/6.jpg not downloaded yet
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/7.jpg not downloaded yet
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/8.jpg not downloaded yet
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/9.jpg not downloaded yet
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/10.jpg not downloaded yet
2026-03-26 21:46:12 [ayvens.de] INFO: Found listing with ID: 1985083
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985083%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [ayvens.de] INFO: Scrape type for 1985083: 1
2026-03-26 21:46:12 [ayvens.de] INFO: Extracting data for car ID: 1985083
2026-03-26 21:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb187fa8-57ec-5199-b7e6-c05373c6aa57 with identifier: 1985083
2026-03-26 21:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb187fa8-57ec-5199-b7e6-c05373c6aa57 with scrape type 1
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/1.jpg not downloaded yet
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d999890>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/6.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7ef410>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/4.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/2.jpg not downloaded yet
2026-03-26 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/3.jpg not downloaded yet
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7fe390>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/9.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad2750>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/1.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75ee10>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/5.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ea750>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/10.jpg saved to cache
2026-03-26 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6a0f10>
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/9.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7b81d0>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/10.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/4.jpg not downloaded yet
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/5.jpg not downloaded yet
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17f7d0>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/2.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/6.jpg not downloaded yet
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/7.jpg not downloaded yet
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/8.jpg not downloaded yet
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/9.jpg not downloaded yet
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%C3%B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gö-/8c20a28932fb4cd183b814153617b06e/images/large/10.jpg not downloaded yet
2026-03-26 21:46:13 [ayvens.de] INFO: Found listing with ID: 1985084
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985084%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [ayvens.de] INFO: Scrape type for 1985084: 1
2026-03-26 21:46:13 [ayvens.de] INFO: Extracting data for car ID: 1985084
2026-03-26 21:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f929186-38b4-5b87-b402-d162319cbfed with identifier: 1985084
2026-03-26 21:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f929186-38b4-5b87-b402-d162319cbfed with scrape type 1
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/1.jpg not downloaded yet
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/2.jpg not downloaded yet
2026-03-26 21:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da3a690>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/1.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d692310>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/1.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/3.jpg not downloaded yet
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f73f2d0>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/9.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7ce5d0>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/4.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6dfc10>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/2.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da95150>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/3.jpg saved to cache
2026-03-26 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6f3950>
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/10.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/4.jpg not downloaded yet
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/5.jpg not downloaded yet
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6f2010>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/3.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/6.jpg not downloaded yet
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/7.jpg not downloaded yet
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/8.jpg not downloaded yet
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/9.jpg not downloaded yet
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/10.jpg not downloaded yet
2026-03-26 21:46:14 [ayvens.de] INFO: Found listing with ID: 1985085
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985085%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [ayvens.de] INFO: Scrape type for 1985085: 1
2026-03-26 21:46:14 [ayvens.de] INFO: Extracting data for car ID: 1985085
2026-03-26 21:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with identifier: 1985085
2026-03-26 21:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with scrape type 1
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/1.jpg not downloaded yet
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/2.jpg not downloaded yet
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75ecd0>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/3.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/3.jpg not downloaded yet
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1abed0>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/2.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75ff10>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/1.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f603dd0>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/5.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/4.jpg not downloaded yet
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/5.jpg not downloaded yet
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d692550>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/4.jpg saved to cache
2026-03-26 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f737810>
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/10.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8e0110>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/9.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d88bf10>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/8.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/6.jpg not downloaded yet
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/7.jpg not downloaded yet
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/8.jpg not downloaded yet
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/9.jpg not downloaded yet
2026-03-26 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/10.jpg not downloaded yet
2026-03-26 21:46:15 [ayvens.de] INFO: Found listing with ID: 1985086
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985086%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [ayvens.de] INFO: Scrape type for 1985086: 1
2026-03-26 21:46:15 [ayvens.de] INFO: Extracting data for car ID: 1985086
2026-03-26 21:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c7def9-fff4-593e-b709-26d7926bd5f6 with identifier: 1985086
2026-03-26 21:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c7def9-fff4-593e-b709-26d7926bd5f6 with scrape type 1
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/1.jpg not downloaded yet
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/2.jpg not downloaded yet
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad2c50>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/5.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd60950>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/6.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd023d0>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/3.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd60190>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/7.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86a9d0>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/4.jpg saved to cache
2026-03-26 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd46490>
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/8.jpg saved to cache
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd02610>
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/7.jpg saved to cache
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f7c71d0>
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F3607edf6ba6e4e0e88e91a556a997994%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/6.jpg saved to cache
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c1c686c-e077-5388-9cc7-13fea55fd115
2026-03-26 21:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c1c686c-e077-5388-9cc7-13fea55fd115, skipping ID generation
2026-03-26 21:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1c686c-e077-5388-9cc7-13fea55fd115 with scrape type 1
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c1c686c-e077-5388-9cc7-13fea55fd115 sending to next pipeline
2026-03-26 21:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3c1c686c-e077-5388-9cc7-13fea55fd115, identifier: 1985082
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/3.jpg not downloaded yet
2026-03-26 21:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3c1c686c-e077-5388-9cc7-13fea55fd115 with identifier: 1985082
2026-03-26 21:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3c1c686c-e077-5388-9cc7-13fea55fd115 with identifier: 1985082
2026-03-26 21:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3c1c686c-e077-5388-9cc7-13fea55fd115 with identifier: 1985082 to the API
2026-03-26 21:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': '3c1c686c-e077-5388-9cc7-13fea55fd115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Courier',
 'odometer': 26159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1c686c-e077-5388-9cc7-13fea55fd115/3c1c686c-e077-5388-9cc7-13fea55fd115_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/3607edf6ba6e4e0e88e91a556a997994/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Courier FORD Transit Courier Trend Kasten, 4-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Courier Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2018}
2026-03-26 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985082%27 HTTP/1.1" 200 None
2026-03-26 21:46:17 [ayvens.de] INFO: Saving data for 1985082: {'created_time': 1774561577.981115, 'last_price_update_time': 1774561577.981127, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985082') HTTP/1.1" 204 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/4.jpg not downloaded yet
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/5.jpg not downloaded yet
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/6.jpg not downloaded yet
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/7.jpg not downloaded yet
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/8.jpg not downloaded yet
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/9.jpg not downloaded yet
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/10.jpg not downloaded yet
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da71310>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/5.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:18 [ayvens.de] INFO: Found listing with ID: 1985087
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985087%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [ayvens.de] INFO: Scrape type for 1985087: 1
2026-03-26 21:46:18 [ayvens.de] INFO: Extracting data for car ID: 1985087
2026-03-26 21:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with identifier: 1985087
2026-03-26 21:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with scrape type 1
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/1.jpg not downloaded yet
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d99ac10>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/7.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dbb87d0>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/6.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ac310>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/4.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f728a50>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/1.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/2.jpg not downloaded yet
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/3.jpg not downloaded yet
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7642d0>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/3.jpg saved to cache
2026-03-26 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbe790>
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/2.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86c850>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/10.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/4.jpg not downloaded yet
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/5.jpg not downloaded yet
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/6.jpg not downloaded yet
2026-03-26 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/7.jpg not downloaded yet
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/8.jpg not downloaded yet
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/9.jpg not downloaded yet
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1dc10>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/9.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dbbbd10>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/5.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/10.jpg not downloaded yet
2026-03-26 21:46:19 [ayvens.de] INFO: Found listing with ID: 1985088
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985088%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [ayvens.de] INFO: Scrape type for 1985088: 1
2026-03-26 21:46:19 [ayvens.de] INFO: Extracting data for car ID: 1985088
2026-03-26 21:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with identifier: 1985088
2026-03-26 21:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with scrape type 1
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/1.jpg not downloaded yet
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/2.jpg not downloaded yet
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d925f50>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/4.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6d5610>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/6.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f9590>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/8.jpg saved to cache
2026-03-26 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1d1c10>
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/3.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f9810>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/7.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f776810>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/2.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/3.jpg not downloaded yet
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/4.jpg not downloaded yet
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/5.jpg not downloaded yet
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/6.jpg not downloaded yet
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/7.jpg not downloaded yet
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/8.jpg not downloaded yet
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/9.jpg not downloaded yet
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/10.jpg not downloaded yet
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d898b10>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/4.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d89b3d0>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/1.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:20 [ayvens.de] INFO: Found listing with ID: 1985089
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985089%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [ayvens.de] INFO: Scrape type for 1985089: 1
2026-03-26 21:46:20 [ayvens.de] INFO: Extracting data for car ID: 1985089
2026-03-26 21:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b914de-fa64-5c71-8e12-1decb521e273 with identifier: 1985089
2026-03-26 21:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b914de-fa64-5c71-8e12-1decb521e273 with scrape type 1
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/1.jpg not downloaded yet
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddde390>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/5.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/2.jpg not downloaded yet
2026-03-26 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/3.jpg not downloaded yet
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75f650>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/10.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18e050>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/8.jpg saved to cache
2026-03-26 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db03fd0>
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/1.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b2050>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/9.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d16d710>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/7.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/4.jpg not downloaded yet
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/5.jpg not downloaded yet
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f7c5ed0>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/4.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/6.jpg not downloaded yet
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/7.jpg not downloaded yet
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/8.jpg not downloaded yet
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f70c290>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/3.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f70c2d0>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/5.jpg saved to cache
2026-03-26 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1d2d0>
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/10.jpg saved to cache
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/9.jpg not downloaded yet
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/10.jpg not downloaded yet
2026-03-26 21:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f70cd50>
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/2.jpg saved to cache
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86cf10>
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/10.jpg saved to cache
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da3b090>
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fho-%252F8405879ad60a467da68dd6d0b5b77855%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/6.jpg saved to cache
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59c7def9-fff4-593e-b709-26d7926bd5f6
2026-03-26 21:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59c7def9-fff4-593e-b709-26d7926bd5f6, skipping ID generation
2026-03-26 21:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c7def9-fff4-593e-b709-26d7926bd5f6 with scrape type 1
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59c7def9-fff4-593e-b709-26d7926bd5f6 sending to next pipeline
2026-03-26 21:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 59c7def9-fff4-593e-b709-26d7926bd5f6, identifier: 1985086
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d87b890>
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/9.jpg saved to cache
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:22 [ayvens.de] INFO: Found listing with ID: 1985090
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985090%27 HTTP/1.1" 200 None
2026-03-26 21:46:22 [ayvens.de] INFO: Scrape type for 1985090: 1
2026-03-26 21:46:22 [ayvens.de] INFO: Extracting data for car ID: 1985090
2026-03-26 21:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7a3955-7ca4-5185-857c-f89a45983f2c with identifier: 1985090
2026-03-26 21:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7a3955-7ca4-5185-857c-f89a45983f2c with scrape type 1
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/1.jpg not downloaded yet
2026-03-26 21:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 59c7def9-fff4-593e-b709-26d7926bd5f6 with identifier: 1985086
2026-03-26 21:46:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 59c7def9-fff4-593e-b709-26d7926bd5f6 with identifier: 1985086
2026-03-26 21:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 59c7def9-fff4-593e-b709-26d7926bd5f6 with identifier: 1985086 to the API
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '59c7def9-fff4-593e-b709-26d7926bd5f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 75668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59c7def9-fff4-593e-b709-26d7926bd5f6/59c7def9-fff4-593e-b709-26d7926bd5f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ho-/8405879ad60a467da68dd6d0b5b77855/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Style Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Style Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985086%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [ayvens.de] INFO: Saving data for 1985086: {'created_time': 1774561583.330102, 'last_price_update_time': 1774561583.330112, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985086') HTTP/1.1" 204 0
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/2.jpg not downloaded yet
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/3.jpg not downloaded yet
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f702e90>
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/3.jpg saved to cache
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/4.jpg not downloaded yet
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/5.jpg not downloaded yet
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da7bb10>
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/2.jpg saved to cache
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b2490>
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/8.jpg saved to cache
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/6.jpg not downloaded yet
2026-03-26 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/7.jpg not downloaded yet
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/8.jpg not downloaded yet
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74e9d0>
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/1.jpg saved to cache
2026-03-26 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18ef10>
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/4.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9e8310>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/9.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d71aed0>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/10.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9d6910>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/1.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/9.jpg not downloaded yet
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/10.jpg not downloaded yet
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa4b50>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/2.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [ayvens.de] INFO: Found listing with ID: 1985091
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985091%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [ayvens.de] INFO: Scrape type for 1985091: 1
2026-03-26 21:46:24 [ayvens.de] INFO: Extracting data for car ID: 1985091
2026-03-26 21:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1985091
2026-03-26 21:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 1
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/1.jpg not downloaded yet
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/2.jpg not downloaded yet
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/3.jpg not downloaded yet
2026-03-26 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/4.jpg not downloaded yet
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/5.jpg not downloaded yet
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d691850>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/8.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/6.jpg not downloaded yet
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/7.jpg not downloaded yet
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/8.jpg not downloaded yet
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9d4210>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/6.jpg saved to cache
2026-03-26 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6faf90>
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/9.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f725b90>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/4.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac36d0>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/7.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dda1a10>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/3.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac1350>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/5.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1a9bd0>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/9.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/9.jpg not downloaded yet
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/10.jpg not downloaded yet
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [ayvens.de] INFO: Found listing with ID: 1985092
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985092%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [ayvens.de] INFO: Scrape type for 1985092: 1
2026-03-26 21:46:25 [ayvens.de] INFO: Extracting data for car ID: 1985092
2026-03-26 21:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with identifier: 1985092
2026-03-26 21:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with scrape type 1
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/1.jpg not downloaded yet
2026-03-26 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/2.jpg not downloaded yet
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/3.jpg not downloaded yet
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/4.jpg not downloaded yet
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/5.jpg not downloaded yet
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d686ad0>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/7.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/6.jpg not downloaded yet
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6d4450>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/3.jpg saved to cache
2026-03-26 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f73f210>
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/10.jpg saved to cache
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f75e250>
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/1.jpg saved to cache
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7ce410>
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252Fb1444cc2352949489cd7b55ba83f13da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/8.jpg saved to cache
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86b914de-fa64-5c71-8e12-1decb521e273
2026-03-26 21:46:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86b914de-fa64-5c71-8e12-1decb521e273, skipping ID generation
2026-03-26 21:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b914de-fa64-5c71-8e12-1decb521e273 with scrape type 1
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86b914de-fa64-5c71-8e12-1decb521e273 sending to next pipeline
2026-03-26 21:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 86b914de-fa64-5c71-8e12-1decb521e273, identifier: 1985089
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dda1310>
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/2.jpg saved to cache
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18de50>
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/6.jpg saved to cache
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/7.jpg not downloaded yet
2026-03-26 21:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 86b914de-fa64-5c71-8e12-1decb521e273 with identifier: 1985089
2026-03-26 21:46:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 86b914de-fa64-5c71-8e12-1decb521e273 with identifier: 1985089
2026-03-26 21:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 86b914de-fa64-5c71-8e12-1decb521e273 with identifier: 1985089 to the API
2026-03-26 21:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Solid Black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '86b914de-fa64-5c71-8e12-1decb521e273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 32065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86b914de-fa64-5c71-8e12-1decb521e273/86b914de-fa64-5c71-8e12-1decb521e273_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/b1444cc2352949489cd7b55ba83f13da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985089%27 HTTP/1.1" 200 None
2026-03-26 21:46:27 [ayvens.de] INFO: Saving data for 1985089: {'created_time': 1774561587.82682, 'last_price_update_time': 1774561587.826831, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985089') HTTP/1.1" 204 0
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f7b50>
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/6.jpg saved to cache
2026-03-26 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/8.jpg not downloaded yet
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/9.jpg not downloaded yet
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f45d0>
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/10.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/10.jpg not downloaded yet
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [ayvens.de] INFO: Found listing with ID: 1985093
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985093%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [ayvens.de] INFO: Scrape type for 1985093: 1
2026-03-26 21:46:28 [ayvens.de] INFO: Extracting data for car ID: 1985093
2026-03-26 21:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb742aa9-21e1-556b-9100-556bd6964aa5 with identifier: 1985093
2026-03-26 21:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb742aa9-21e1-556b-9100-556bd6964aa5 with scrape type 1
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/1.jpg not downloaded yet
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/2.jpg not downloaded yet
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/3.jpg not downloaded yet
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80fa10>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/4.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da8c710>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/6.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7330d0>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/1.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9583d0>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/9.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f72ef90>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/8.jpg saved to cache
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/4.jpg not downloaded yet
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/5.jpg not downloaded yet
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/6.jpg not downloaded yet
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f737590>
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/7.jpg saved to cache
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d99a4d0>
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fce81d95befa54717b5727e74ed96c1eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/5.jpg saved to cache
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7a3955-7ca4-5185-857c-f89a45983f2c
2026-03-26 21:46:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7a3955-7ca4-5185-857c-f89a45983f2c, skipping ID generation
2026-03-26 21:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7a3955-7ca4-5185-857c-f89a45983f2c with scrape type 1
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7a3955-7ca4-5185-857c-f89a45983f2c sending to next pipeline
2026-03-26 21:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1f7a3955-7ca4-5185-857c-f89a45983f2c, identifier: 1985090
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8d4490>
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/9.jpg saved to cache
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1f7a3955-7ca4-5185-857c-f89a45983f2c with identifier: 1985090
2026-03-26 21:46:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1f7a3955-7ca4-5185-857c-f89a45983f2c with identifier: 1985090
2026-03-26 21:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1f7a3955-7ca4-5185-857c-f89a45983f2c with identifier: 1985090 to the API
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f7a3955-7ca4-5185-857c-f89a45983f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 130952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7a3955-7ca4-5185-857c-f89a45983f2c/1f7a3955-7ca4-5185-857c-f89a45983f2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ce81d95befa54717b5727e74ed96c1eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat VW Passat Variant 2.0 TDI SCR DSG Business Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'VW Passat Variant 2.0 TDI SCR DSG Business Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985090%27 HTTP/1.1" 200 None
2026-03-26 21:46:29 [ayvens.de] INFO: Saving data for 1985090: {'created_time': 1774561589.700779, 'last_price_update_time': 1774561589.700787, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985090') HTTP/1.1" 204 0
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/7.jpg not downloaded yet
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/8.jpg not downloaded yet
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c5410>
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/8.jpg saved to cache
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/9.jpg not downloaded yet
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/10.jpg not downloaded yet
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7677d0>
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/7.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f750e10>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/10.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8feb50>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/5.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:30 [ayvens.de] INFO: Found listing with ID: 1985094
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985094%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [ayvens.de] INFO: Scrape type for 1985094: 1
2026-03-26 21:46:30 [ayvens.de] INFO: Extracting data for car ID: 1985094
2026-03-26 21:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1985094
2026-03-26 21:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 1
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/1.jpg not downloaded yet
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/2.jpg not downloaded yet
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8727d0>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/4.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da7b4d0>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/3.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/3.jpg not downloaded yet
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/4.jpg not downloaded yet
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/5.jpg not downloaded yet
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db26d10>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/6.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5dad10>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/7.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/6.jpg not downloaded yet
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/7.jpg not downloaded yet
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7fa190>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/8.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8e3c50>
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/9.jpg saved to cache
2026-03-26 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/8.jpg not downloaded yet
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/9.jpg not downloaded yet
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/10.jpg not downloaded yet
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da964d0>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/5.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d89a590>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/10.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:31 [ayvens.de] INFO: Found listing with ID: 1985095
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985095%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [ayvens.de] INFO: Scrape type for 1985095: 1
2026-03-26 21:46:31 [ayvens.de] INFO: Extracting data for car ID: 1985095
2026-03-26 21:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with identifier: 1985095
2026-03-26 21:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with scrape type 1
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/1.jpg not downloaded yet
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/2.jpg not downloaded yet
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dbb3850>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/4.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad1350>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/1.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1eb50>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/4.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/3.jpg not downloaded yet
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/4.jpg not downloaded yet
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/5.jpg not downloaded yet
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dba7210>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/3.jpg saved to cache
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/6.jpg not downloaded yet
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/7.jpg not downloaded yet
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9c2fd0>
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/5.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8ee310>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/2.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc38b10>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/7.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f7550>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/6.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/8.jpg not downloaded yet
2026-03-26 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/9.jpg not downloaded yet
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/10.jpg not downloaded yet
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d959410>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/10.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c6b90>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/8.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7666d0>
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-n%252Fc58354fcd7b64e58a54376776651fc97%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/9.jpg saved to cache
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb742aa9-21e1-556b-9100-556bd6964aa5
2026-03-26 21:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb742aa9-21e1-556b-9100-556bd6964aa5, skipping ID generation
2026-03-26 21:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb742aa9-21e1-556b-9100-556bd6964aa5 with scrape type 1
2026-03-26 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb742aa9-21e1-556b-9100-556bd6964aa5 sending to next pipeline
2026-03-26 21:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: eb742aa9-21e1-556b-9100-556bd6964aa5, identifier: 1985093
2026-03-26 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: eb742aa9-21e1-556b-9100-556bd6964aa5 with identifier: 1985093
2026-03-26 21:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: eb742aa9-21e1-556b-9100-556bd6964aa5 with identifier: 1985093
2026-03-26 21:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: eb742aa9-21e1-556b-9100-556bd6964aa5 with identifier: 1985093 to the API
2026-03-26 21:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'eb742aa9-21e1-556b-9100-556bd6964aa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 13544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb742aa9-21e1-556b-9100-556bd6964aa5/eb742aa9-21e1-556b-9100-556bd6964aa5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-n/c58354fcd7b64e58a54376776651fc97/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON HYUNDAI TUCSON 1.6 T-GDi Plug-in-Hybrid 4WD N Line '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI TUCSON 1.6 T-GDi Plug-in-Hybrid 4WD N Line Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985093%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [ayvens.de] INFO: Saving data for 1985093: {'created_time': 1774561593.251909, 'last_price_update_time': 1774561593.251918, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985093') HTTP/1.1" 204 0
2026-03-26 21:46:33 [ayvens.de] INFO: Found listing with ID: 1985096
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985096%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [ayvens.de] INFO: Scrape type for 1985096: 1
2026-03-26 21:46:33 [ayvens.de] INFO: Extracting data for car ID: 1985096
2026-03-26 21:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1985096
2026-03-26 21:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 1
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/1.jpg not downloaded yet
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/2.jpg not downloaded yet
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc77290>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/1.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da5d210>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/3.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da19d10>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/2.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8d4410>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/4.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9c23d0>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/5.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/3.jpg not downloaded yet
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/4.jpg not downloaded yet
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/5.jpg not downloaded yet
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/6.jpg not downloaded yet
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/7.jpg not downloaded yet
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/8.jpg not downloaded yet
2026-03-26 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f30d0>
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/8.jpg saved to cache
2026-03-26 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/9.jpg not downloaded yet
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c5350>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/6.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/10.jpg not downloaded yet
2026-03-26 21:46:34 [ayvens.de] INFO: Found listing with ID: 1984990
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984990%27 HTTP/1.1" 200 None
2026-03-26 21:46:34 [ayvens.de] INFO: Scrape type for 1984990: 1
2026-03-26 21:46:34 [ayvens.de] INFO: Extracting data for car ID: 1984990
2026-03-26 21:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1984990
2026-03-26 21:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with scrape type 1
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/1.jpg not downloaded yet
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da70f10>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/7.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d690f90>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/10.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f3590>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/3.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc39510>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/2.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7f31d0>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/1.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d724710>
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsk-%252Ff1bd4ecb6d7144cda1ca828a7ac431ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/9.jpg saved to cache
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3139121-61f7-5733-97da-8f11b6a26a67
2026-03-26 21:46:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3139121-61f7-5733-97da-8f11b6a26a67, skipping ID generation
2026-03-26 21:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3139121-61f7-5733-97da-8f11b6a26a67 with scrape type 1
2026-03-26 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3139121-61f7-5733-97da-8f11b6a26a67 sending to next pipeline
2026-03-26 21:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d3139121-61f7-5733-97da-8f11b6a26a67, identifier: 1985094
2026-03-26 21:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1985094
2026-03-26 21:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1985094
2026-03-26 21:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d3139121-61f7-5733-97da-8f11b6a26a67 with identifier: 1985094 to the API
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3139121-61f7-5733-97da-8f11b6a26a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mondeo',
 'odometer': 92195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3139121-61f7-5733-97da-8f11b6a26a67/d3139121-61f7-5733-97da-8f11b6a26a67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sk-/f1bd4ecb6d7144cda1ca828a7ac431ec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mondeo FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Mondeo Turnier 2.0 EcoBlue Aut. Titanium Kombi, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985094%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [ayvens.de] INFO: Saving data for 1985094: {'created_time': 1774561595.301543, 'last_price_update_time': 1774561595.301554, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985094') HTTP/1.1" 204 0
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/2.jpg not downloaded yet
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/3.jpg not downloaded yet
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/4.jpg not downloaded yet
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/5.jpg not downloaded yet
2026-03-26 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/6.jpg not downloaded yet
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/7.jpg not downloaded yet
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/8.jpg not downloaded yet
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8e3c10>
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/8.jpg saved to cache
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/9.jpg not downloaded yet
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/10.jpg not downloaded yet
2026-03-26 21:46:35 [ayvens.de] INFO: Found listing with ID: 1984991
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984991%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [ayvens.de] INFO: Scrape type for 1984991: 1
2026-03-26 21:46:35 [ayvens.de] INFO: Extracting data for car ID: 1984991
2026-03-26 21:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1984991
2026-03-26 21:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/1.jpg not downloaded yet
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d861490>
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/7.jpg saved to cache
2026-03-26 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbe150>
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/6.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6b0250>
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/5.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dac0610>
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/10.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da3c750>
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/9.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbe790>
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fof-%252F2e10b7073edf4385b66a3a1b64313abf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/4.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371
2026-03-26 21:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8fc9b70-4ec3-5b92-af93-6c5f409b0371, skipping ID generation
2026-03-26 21:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with scrape type 1
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8fc9b70-4ec3-5b92-af93-6c5f409b0371 sending to next pipeline
2026-03-26 21:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f8fc9b70-4ec3-5b92-af93-6c5f409b0371, identifier: 1985095
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69fafca10>
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/3.jpg saved to cache
2026-03-26 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with identifier: 1985095
2026-03-26 21:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with identifier: 1985095
2026-03-26 21:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f8fc9b70-4ec3-5b92-af93-6c5f409b0371 with identifier: 1985095 to the API
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'f8fc9b70-4ec3-5b92-af93-6c5f409b0371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ 5',
 'odometer': 37893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fc9b70-4ec3-5b92-af93-6c5f409b0371/f8fc9b70-4ec3-5b92-af93-6c5f409b0371_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/of-/2e10b7073edf4385b66a3a1b64313abf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 5 HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI IONIQ 5 72,6 kWh Uniq Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985095%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [ayvens.de] INFO: Saving data for 1985095: {'created_time': 1774561597.066392, 'last_price_update_time': 1774561597.066412, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985095') HTTP/1.1" 204 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/2.jpg not downloaded yet
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/3.jpg not downloaded yet
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f717f50>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/2.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/4.jpg not downloaded yet
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/5.jpg not downloaded yet
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/6.jpg not downloaded yet
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/7.jpg not downloaded yet
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/8.jpg not downloaded yet
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/9.jpg not downloaded yet
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/10.jpg not downloaded yet
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d89bfd0>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/4.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da96250>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/9.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [ayvens.de] INFO: Found listing with ID: 1984992
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984992%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [ayvens.de] INFO: Scrape type for 1984992: 1
2026-03-26 21:46:37 [ayvens.de] INFO: Extracting data for car ID: 1984992
2026-03-26 21:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1984992
2026-03-26 21:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/1.jpg not downloaded yet
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f750f50>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/1.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7cf150>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/3.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8d4610>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/5.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7cfe50>
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/6.jpg saved to cache
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/2.jpg not downloaded yet
2026-03-26 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/3.jpg not downloaded yet
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8ee490>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/2.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17c9d0>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/1.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/4.jpg not downloaded yet
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/5.jpg not downloaded yet
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c4c90>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/10.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/6.jpg not downloaded yet
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/7.jpg not downloaded yet
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/8.jpg not downloaded yet
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dbbb950>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/4.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da8f890>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/2.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d19da90>
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fkl-%252F53580d04dcc445e8a2a52b39c8cc0dbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/1.jpg saved to cache
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9
2026-03-26 21:46:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9, skipping ID generation
2026-03-26 21:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with scrape type 1
2026-03-26 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 sending to next pipeline
2026-03-26 21:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9, identifier: 1985092
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5e0090>
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/8.jpg saved to cache
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with identifier: 1985092
2026-03-26 21:46:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with identifier: 1985092
2026-03-26 21:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9 with identifier: 1985092 to the API
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Fuji White',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-Pace',
 'odometer': 60451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9/2e1b4940-44ec-5bc9-9c7f-3ba4105aabc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/kl-/53580d04dcc445e8a2a52b39c8cc0dbc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-Pace JAGUAR E-Pace D165 AWD Aut. R-Dynamic HSE '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'JAGUAR E-Pace D165 AWD Aut. R-Dynamic HSE Geschlossen, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985092%27 HTTP/1.1" 200 None
2026-03-26 21:46:39 [ayvens.de] INFO: Saving data for 1985092: {'created_time': 1774561599.533638, 'last_price_update_time': 1774561599.533649, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985092') HTTP/1.1" 204 0
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/9.jpg not downloaded yet
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/10.jpg not downloaded yet
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6ea750>
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/3.jpg saved to cache
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86f550>
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/1.jpg saved to cache
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f775a50>
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdo-%252F4e2d3295c3c144dc837d3ea3169a4fda%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/7.jpg saved to cache
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be174198-dc82-584e-96c3-b82d1b969eee
2026-03-26 21:46:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be174198-dc82-584e-96c3-b82d1b969eee, skipping ID generation
2026-03-26 21:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be174198-dc82-584e-96c3-b82d1b969eee with scrape type 1
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be174198-dc82-584e-96c3-b82d1b969eee sending to next pipeline
2026-03-26 21:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: be174198-dc82-584e-96c3-b82d1b969eee, identifier: 1985096
2026-03-26 21:46:39 [ayvens.de] INFO: Found listing with ID: 1984993
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984993%27 HTTP/1.1" 200 None
2026-03-26 21:46:39 [ayvens.de] INFO: Scrape type for 1984993: 1
2026-03-26 21:46:39 [ayvens.de] INFO: Extracting data for car ID: 1984993
2026-03-26 21:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1984993
2026-03-26 21:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/1.jpg not downloaded yet
2026-03-26 21:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1985096
2026-03-26 21:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1985096
2026-03-26 21:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: be174198-dc82-584e-96c3-b82d1b969eee with identifier: 1985096 to the API
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'be174198-dc82-584e-96c3-b82d1b969eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 70856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be174198-dc82-584e-96c3-b82d1b969eee/be174198-dc82-584e-96c3-b82d1b969eee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/do-/4e2d3295c3c144dc837d3ea3169a4fda/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE X Kombi, '
         '5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985096%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [ayvens.de] INFO: Saving data for 1985096: {'created_time': 1774561600.335636, 'last_price_update_time': 1774561600.335648, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985096') HTTP/1.1" 204 0
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/2.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/3.jpg not downloaded yet
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/4.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/5.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/6.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/7.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/8.jpg not downloaded yet
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da5d690>
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/3.jpg saved to cache
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/9.jpg not downloaded yet
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/10.jpg not downloaded yet
2026-03-26 21:46:40 [ayvens.de] INFO: Found listing with ID: 1984994
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984994%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [ayvens.de] INFO: Scrape type for 1984994: 1
2026-03-26 21:46:40 [ayvens.de] INFO: Extracting data for car ID: 1984994
2026-03-26 21:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1984994
2026-03-26 21:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/1.jpg not downloaded yet
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d911350>
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/2.jpg saved to cache
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d95af10>
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/10.jpg saved to cache
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d959350>
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/1.jpg saved to cache
2026-03-26 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69ddbf7d0>
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/4.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6dc550>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/8.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc1c990>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/10.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86b710>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/9.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/2.jpg not downloaded yet
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/3.jpg not downloaded yet
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/4.jpg not downloaded yet
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/5.jpg not downloaded yet
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/6.jpg not downloaded yet
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/7.jpg not downloaded yet
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/8.jpg not downloaded yet
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/9.jpg not downloaded yet
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d958390>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/2.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dd47a10>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/8.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/10.jpg not downloaded yet
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d17d6d0>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/4.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d924f90>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/3.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d862150>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/5.jpg saved to cache
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:41 [ayvens.de] INFO: Found listing with ID: 1984995
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984995%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [ayvens.de] INFO: Scrape type for 1984995: 1
2026-03-26 21:46:41 [ayvens.de] INFO: Extracting data for car ID: 1984995
2026-03-26 21:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1984995
2026-03-26 21:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/1.jpg not downloaded yet
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86ff10>
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/8.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f777350>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/7.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db03810>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/9.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/2.jpg not downloaded yet
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/3.jpg not downloaded yet
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/4.jpg not downloaded yet
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/5.jpg not downloaded yet
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/6.jpg not downloaded yet
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/7.jpg not downloaded yet
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/8.jpg not downloaded yet
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/9.jpg not downloaded yet
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f776550>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/1.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc00890>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/3.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dcefc50>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/5.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc03c50>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/9.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c3b90>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/8.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daec810>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/6.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db01f10>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/7.jpg saved to cache
2026-03-26 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f6001d0>
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/4.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/10.jpg not downloaded yet
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [ayvens.de] INFO: Found listing with ID: 1984996
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984996%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [ayvens.de] INFO: Scrape type for 1984996: 1
2026-03-26 21:46:43 [ayvens.de] INFO: Extracting data for car ID: 1984996
2026-03-26 21:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1984996
2026-03-26 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/1.jpg not downloaded yet
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/2.jpg not downloaded yet
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/3.jpg not downloaded yet
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/4.jpg not downloaded yet
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/5.jpg not downloaded yet
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d707610>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/2.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/6.jpg not downloaded yet
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/7.jpg not downloaded yet
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/8.jpg not downloaded yet
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d705490>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/1.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f701e90>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/3.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9d4250>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/2.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f700390>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/9.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c2590>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/10.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1d2a10>
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/10.jpg saved to cache
2026-03-26 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9d4590>
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F6d50e4ad1fd2418682c99de699337beb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/10.jpg saved to cache
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-26 21:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66796465-7353-572a-9087-319a58d72a35, skipping ID generation
2026-03-26 21:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66796465-7353-572a-9087-319a58d72a35 sending to next pipeline
2026-03-26 21:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 66796465-7353-572a-9087-319a58d72a35, identifier: 1984993
2026-03-26 21:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1984993
2026-03-26 21:46:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1984993
2026-03-26 21:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1984993 to the API
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'color': 'Fuji White uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '66796465-7353-572a-9087-319a58d72a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Velar',
 'odometer': 86665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/6d50e4ad1fd2418682c99de699337beb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Velar LAND ROVER Range Rover Velar P400e '
          'R-Dynamic Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Velar P400e R-Dynamic Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984993%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [ayvens.de] INFO: Saving data for 1984993: {'created_time': 1774561604.73733, 'last_price_update_time': 1774561604.73734, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984993') HTTP/1.1" 204 0
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/9.jpg not downloaded yet
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/10.jpg not downloaded yet
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [ayvens.de] INFO: Found listing with ID: 1984997
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984997%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [ayvens.de] INFO: Scrape type for 1984997: 1
2026-03-26 21:46:44 [ayvens.de] INFO: Extracting data for car ID: 1984997
2026-03-26 21:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1984997
2026-03-26 21:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/1.jpg not downloaded yet
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/2.jpg not downloaded yet
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/3.jpg not downloaded yet
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/4.jpg not downloaded yet
2026-03-26 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/5.jpg not downloaded yet
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/6.jpg not downloaded yet
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db27250>
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/1.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d710690>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/2.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db27050>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/8.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8891d0>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/8.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/7.jpg not downloaded yet
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/8.jpg not downloaded yet
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/9.jpg not downloaded yet
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d875010>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/7.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6ebc50>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/10.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1c1210>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/9.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d99ad50>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/7.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/10.jpg not downloaded yet
2026-03-26 21:46:45 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f765e50>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/2.jpg saved to cache
2026-03-26 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1aa290>
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/8.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6de050>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/1.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da70c10>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/9.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da39750>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/5.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d80fa50>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/6.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8f9a50>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/7.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8f8d50>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/6.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa6d50>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/4.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8e0a90>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/6.jpg saved to cache
2026-03-26 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d85b610>
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/5.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f74a310>
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/10.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8d7a50>
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd866a225a460435a8654ea800ab03d3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/3.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-26 21:46:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, skipping ID generation
2026-03-26 21:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 sending to next pipeline
2026-03-26 21:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, identifier: 1984996
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d925110>
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/4.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d718f10>
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/7.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1984996
2026-03-26 21:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1984996
2026-03-26 21:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1984996 to the API
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '01b8707b-00ce-5b13-9e2d-bbf8727e0f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 93012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d866a225a460435a8654ea800ab03d3f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984996%27 HTTP/1.1" 200 None
2026-03-26 21:46:47 [ayvens.de] INFO: Saving data for 1984996: {'created_time': 1774561607.831433, 'last_price_update_time': 1774561607.831443, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984996') HTTP/1.1" 204 0
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c6850>
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/5.jpg saved to cache
2026-03-26 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d960a50>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/10.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d713c50>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/3.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc38310>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/9.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d19e710>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/2.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d704d50>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/1.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d725d50>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/3.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d14bd10>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F7dffe5bacee74ccea915d01a5fc4438c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/8.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-26 21:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39c058b7-1536-5792-97e2-c298dcdfc9fc, skipping ID generation
2026-03-26 21:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39c058b7-1536-5792-97e2-c298dcdfc9fc sending to next pipeline
2026-03-26 21:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 39c058b7-1536-5792-97e2-c298dcdfc9fc, identifier: 1984997
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6fae90>
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa4fdd7d4ef0548269be8a91c74a634f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/4.jpg saved to cache
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-26 21:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59a6003-66df-5951-9d5c-6ccb97fe6914, skipping ID generation
2026-03-26 21:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-26 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59a6003-66df-5951-9d5c-6ccb97fe6914 sending to next pipeline
2026-03-26 21:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f59a6003-66df-5951-9d5c-6ccb97fe6914, identifier: 1984995
2026-03-26 21:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1984997
2026-03-26 21:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1984997
2026-03-26 21:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1984997 to the API
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '39c058b7-1536-5792-97e2-c298dcdfc9fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 55520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/7dffe5bacee74ccea915d01a5fc4438c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984997%27 HTTP/1.1" 200 None
2026-03-26 21:46:49 [ayvens.de] INFO: Saving data for 1984997: {'created_time': 1774561609.302663, 'last_price_update_time': 1774561609.302674, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984997') HTTP/1.1" 204 0
2026-03-26 21:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1984995
2026-03-26 21:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1984995
2026-03-26 21:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1984995 to the API
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f59a6003-66df-5951-9d5c-6ccb97fe6914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 28359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a4fdd7d4ef0548269be8a91c74a634f8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984995%27 HTTP/1.1" 200 None
2026-03-26 21:46:49 [ayvens.de] INFO: Saving data for 1984995: {'created_time': 1774561609.656026, 'last_price_update_time': 1774561609.656036, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984995') HTTP/1.1" 204 0
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d86ea50>
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/6.jpg saved to cache
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d924350>
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/9.jpg saved to cache
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dba6cd0>
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/5.jpg saved to cache
2026-03-26 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d999b10>
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252Faa2145c281c047f5a850e9db5fc0bd62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/4.jpg saved to cache
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-26 21:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, skipping ID generation
2026-03-26 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 sending to next pipeline
2026-03-26 21:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, identifier: 1984994
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d924290>
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/7.jpg saved to cache
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9afad0>
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252F863a5f7150414eb7ac0d06b8c47263a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/6.jpg saved to cache
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-26 21:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d72b9397-852a-5550-89f5-edd56a131f9a, skipping ID generation
2026-03-26 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d72b9397-852a-5550-89f5-edd56a131f9a sending to next pipeline
2026-03-26 21:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d72b9397-852a-5550-89f5-edd56a131f9a, identifier: 1984992
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc3ad50>
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/5.jpg saved to cache
2026-03-26 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1984994
2026-03-26 21:46:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1984994
2026-03-26 21:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1984994 to the API
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '4.4L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eeff5ae-b901-5eac-a750-7d7ed9e326e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/aa2145c281c047f5a850e9db5fc0bd62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover LAND ROVER Range Rover 4.4 SDV8 Vogue '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover 4.4 SDV8 Vogue Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984994%27 HTTP/1.1" 200 None
2026-03-26 21:46:50 [ayvens.de] INFO: Saving data for 1984994: {'created_time': 1774561610.928785, 'last_price_update_time': 1774561610.928795, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984994') HTTP/1.1" 204 0
2026-03-26 21:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1984992
2026-03-26 21:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1984992
2026-03-26 21:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1984992 to the API
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd72b9397-852a-5550-89f5-edd56a131f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 64253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/863a5f7150414eb7ac0d06b8c47263a8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport P300e '
          'R-Dynamic S Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport P300e R-Dynamic S Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984992%27 HTTP/1.1" 200 None
2026-03-26 21:46:51 [ayvens.de] INFO: Saving data for 1984992: {'created_time': 1774561611.807201, 'last_price_update_time': 1774561611.807211, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984992') HTTP/1.1" 204 0
2026-03-26 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d19e1d0>
2026-03-26 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fa13a21b09ac5411eae448d35473bf7c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/6.jpg saved to cache
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-26 21:46:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a42d01-bd07-5f99-a038-a43f584794fa, skipping ID generation
2026-03-26 21:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a42d01-bd07-5f99-a038-a43f584794fa sending to next pipeline
2026-03-26 21:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 67a42d01-bd07-5f99-a038-a43f584794fa, identifier: 1984991
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6e8290>
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/7.jpg saved to cache
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1984991
2026-03-26 21:46:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1984991
2026-03-26 21:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1984991 to the API
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '67a42d01-bd07-5f99-a038-a43f584794fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 120756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/a13a21b09ac5411eae448d35473bf7c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 1.4 eHybrid OPF DSG '
          'R-Line Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 1.4 eHybrid OPF DSG R-Line Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984991%27 HTTP/1.1" 200 None
2026-03-26 21:46:52 [ayvens.de] INFO: Saving data for 1984991: {'created_time': 1774561612.820811, 'last_price_update_time': 1774561612.820822, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984991') HTTP/1.1" 204 0
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d18d910>
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/6.jpg saved to cache
2026-03-26 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d185490>
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/2.jpg saved to cache
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f726c90>
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F3e994937b70f4489a8b54f9df37c4129%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/8.jpg saved to cache
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb
2026-03-26 21:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb, skipping ID generation
2026-03-26 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with scrape type 1
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac871d9f-fb88-53d2-9f42-4df72e9eb3fb sending to next pipeline
2026-03-26 21:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb, identifier: 1985085
2026-03-26 21:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with identifier: 1985085
2026-03-26 21:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with identifier: 1985085
2026-03-26 21:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ac871d9f-fb88-53d2-9f42-4df72e9eb3fb with identifier: 1985085 to the API
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'ac871d9f-fb88-53d2-9f42-4df72e9eb3fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 27501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac871d9f-fb88-53d2-9f42-4df72e9eb3fb/ac871d9f-fb88-53d2-9f42-4df72e9eb3fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/3e994937b70f4489a8b54f9df37c4129/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI KONA EV EDITION 30+ Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI KONA EV EDITION 30+ Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985085%27 HTTP/1.1" 200 None
2026-03-26 21:46:53 [ayvens.de] INFO: Saving data for 1985085: {'created_time': 1774561613.624804, 'last_price_update_time': 1774561613.624834, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985085') HTTP/1.1" 204 0
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da38350>
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F190e6d75803f4a1db8dc2ddea5d26bbb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/5.jpg saved to cache
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4
2026-03-26 21:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4, skipping ID generation
2026-03-26 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with scrape type 1
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 sending to next pipeline
2026-03-26 21:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4, identifier: 1985088
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dbb1d50>
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-g%252Fe30752603124459aaca577e06942db1d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/2.jpg saved to cache
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5536894-1852-55b1-99dd-4372c9a005f1
2026-03-26 21:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5536894-1852-55b1-99dd-4372c9a005f1, skipping ID generation
2026-03-26 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5536894-1852-55b1-99dd-4372c9a005f1 with scrape type 1
2026-03-26 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5536894-1852-55b1-99dd-4372c9a005f1 sending to next pipeline
2026-03-26 21:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c5536894-1852-55b1-99dd-4372c9a005f1, identifier: 1985091
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f767b50>
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/7.jpg saved to cache
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d684d50>
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Femd%252F94e92555af3b4e90a3b02dd5ecd6f69a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/6.jpg saved to cache
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1
2026-03-26 21:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53eb683-a1c7-5933-ab3b-4ff5d16536d1, skipping ID generation
2026-03-26 21:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with scrape type 1
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53eb683-a1c7-5933-ab3b-4ff5d16536d1 sending to next pipeline
2026-03-26 21:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e53eb683-a1c7-5933-ab3b-4ff5d16536d1, identifier: 1985087
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da38350>
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F80e807da53914f2e853a622592b67207%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/5.jpg saved to cache
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a
2026-03-26 21:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a, skipping ID generation
2026-03-26 21:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with scrape type 1
2026-03-26 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63c26d8c-f4b7-50ce-a6c0-4a69090c571a sending to next pipeline
2026-03-26 21:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a, identifier: 1984990
2026-03-26 21:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with identifier: 1985088
2026-03-26 21:46:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with identifier: 1985088
2026-03-26 21:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6d9ea7e6-acc9-5c70-9fda-c22e69601ea4 with identifier: 1985088 to the API
2026-03-26 21:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '6d9ea7e6-acc9-5c70-9fda-c22e69601ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 55375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9ea7e6-acc9-5c70-9fda-c22e69601ea4/6d9ea7e6-acc9-5c70-9fda-c22e69601ea4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/190e6d75803f4a1db8dc2ddea5d26bbb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985088%27 HTTP/1.1" 200 None
2026-03-26 21:46:55 [ayvens.de] INFO: Saving data for 1985088: {'created_time': 1774561615.782138, 'last_price_update_time': 1774561615.782148, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985088') HTTP/1.1" 204 0
2026-03-26 21:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1985091
2026-03-26 21:46:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1985091
2026-03-26 21:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c5536894-1852-55b1-99dd-4372c9a005f1 with identifier: 1985091 to the API
2026-03-26 21:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c5536894-1852-55b1-99dd-4372c9a005f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 19368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5536894-1852-55b1-99dd-4372c9a005f1/c5536894-1852-55b1-99dd-4372c9a005f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-g/e30752603124459aaca577e06942db1d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT AMG Line '
          'Limousine, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT AMG Line Limousine, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985091%27 HTTP/1.1" 200 None
2026-03-26 21:46:56 [ayvens.de] INFO: Saving data for 1985091: {'created_time': 1774561616.154888, 'last_price_update_time': 1774561616.154898, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985091') HTTP/1.1" 204 0
2026-03-26 21:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with identifier: 1985087
2026-03-26 21:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with identifier: 1985087
2026-03-26 21:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e53eb683-a1c7-5933-ab3b-4ff5d16536d1 with identifier: 1985087 to the API
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'e53eb683-a1c7-5933-ab3b-4ff5d16536d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 81754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53eb683-a1c7-5933-ab3b-4ff5d16536d1/e53eb683-a1c7-5933-ab3b-4ff5d16536d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/emd/94e92555af3b4e90a3b02dd5ecd6f69a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985087%27 HTTP/1.1" 200 None
2026-03-26 21:46:56 [ayvens.de] INFO: Saving data for 1985087: {'created_time': 1774561616.660502, 'last_price_update_time': 1774561616.660512, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985087') HTTP/1.1" 204 0
2026-03-26 21:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1984990
2026-03-26 21:46:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1984990
2026-03-26 21:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 63c26d8c-f4b7-50ce-a6c0-4a69090c571a with identifier: 1984990 to the API
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '63c26d8c-f4b7-50ce-a6c0-4a69090c571a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41066',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 116378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63c26d8c-f4b7-50ce-a6c0-4a69090c571a/63c26d8c-f4b7-50ce-a6c0-4a69090c571a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/80e807da53914f2e853a622592b67207/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport D150 SE '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport D150 SE Geschlossen, 5-türig, Automatik, '
         '9-Gang',
 'vin': None,
 'year': 2019}
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271984990%27 HTTP/1.1" 200 None
2026-03-26 21:46:57 [ayvens.de] INFO: Saving data for 1984990: {'created_time': 1774561617.043561, 'last_price_update_time': 1774561617.043571, 'auction_closing_time': 1774616400.0}
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1984990') HTTP/1.1" 204 0
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db25050>
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fld-%252F43f3611c93f2456a947dda2da8590dfd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/1.jpg saved to cache
2026-03-26 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f929186-38b4-5b87-b402-d162319cbfed
2026-03-26 21:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f929186-38b4-5b87-b402-d162319cbfed, skipping ID generation
2026-03-26 21:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f929186-38b4-5b87-b402-d162319cbfed with scrape type 1
2026-03-26 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f929186-38b4-5b87-b402-d162319cbfed sending to next pipeline
2026-03-26 21:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0f929186-38b4-5b87-b402-d162319cbfed, identifier: 1985084
2026-03-26 21:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0f929186-38b4-5b87-b402-d162319cbfed with identifier: 1985084
2026-03-26 21:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0f929186-38b4-5b87-b402-d162319cbfed with identifier: 1985084
2026-03-26 21:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0f929186-38b4-5b87-b402-d162319cbfed with identifier: 1985084 to the API
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '0f929186-38b4-5b87-b402-d162319cbfed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 23348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f929186-38b4-5b87-b402-d162319cbfed/0f929186-38b4-5b87-b402-d162319cbfed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ld-/43f3611c93f2456a947dda2da8590dfd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI KONA EV EDITION 30+ Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI KONA EV EDITION 30+ Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985084%27 HTTP/1.1" 200 None
2026-03-26 21:46:57 [ayvens.de] INFO: Saving data for 1985084: {'created_time': 1774561617.723178, 'last_price_update_time': 1774561617.72319, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985084') HTTP/1.1" 204 0
2026-03-26 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d889590>
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/8.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da5d710>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/10.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69db86190>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/5.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dad2c90>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg%25C3%25B6-%252F8c20a28932fb4cd183b814153617b06e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/9.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb187fa8-57ec-5199-b7e6-c05373c6aa57
2026-03-26 21:46:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb187fa8-57ec-5199-b7e6-c05373c6aa57, skipping ID generation
2026-03-26 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb187fa8-57ec-5199-b7e6-c05373c6aa57 with scrape type 1
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb187fa8-57ec-5199-b7e6-c05373c6aa57 sending to next pipeline
2026-03-26 21:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bb187fa8-57ec-5199-b7e6-c05373c6aa57, identifier: 1985083
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6fab50>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/7.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69da5e250>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-h%252F5b9f21a7bcf745e3ab9acf88e959e2a3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/6.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 222757f4-4695-5bb3-961f-07cc7ae01a95
2026-03-26 21:46:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 222757f4-4695-5bb3-961f-07cc7ae01a95, skipping ID generation
2026-03-26 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222757f4-4695-5bb3-961f-07cc7ae01a95 with scrape type 1
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 222757f4-4695-5bb3-961f-07cc7ae01a95 sending to next pipeline
2026-03-26 21:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 222757f4-4695-5bb3-961f-07cc7ae01a95, identifier: 1985081
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f727650>
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/8.jpg saved to cache
2026-03-26 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bb187fa8-57ec-5199-b7e6-c05373c6aa57 with identifier: 1985083
2026-03-26 21:46:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bb187fa8-57ec-5199-b7e6-c05373c6aa57 with identifier: 1985083
2026-03-26 21:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bb187fa8-57ec-5199-b7e6-c05373c6aa57 with identifier: 1985083 to the API
2026-03-26 21:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Shadow Grey Uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb187fa8-57ec-5199-b7e6-c05373c6aa57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'i30',
 'odometer': 95756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb187fa8-57ec-5199-b7e6-c05373c6aa57/bb187fa8-57ec-5199-b7e6-c05373c6aa57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g%C3%B6-/8c20a28932fb4cd183b814153617b06e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI i30 HYUNDAI i30 1.6 CRDI 48V-Hybrid DCT N-Line Limousine, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI i30 1.6 CRDI 48V-Hybrid DCT N-Line Limousine, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985083%27 HTTP/1.1" 200 None
2026-03-26 21:46:59 [ayvens.de] INFO: Saving data for 1985083: {'created_time': 1774561619.198906, 'last_price_update_time': 1774561619.198917, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985083') HTTP/1.1" 204 0
2026-03-26 21:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 222757f4-4695-5bb3-961f-07cc7ae01a95 with identifier: 1985081
2026-03-26 21:46:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 222757f4-4695-5bb3-961f-07cc7ae01a95 with identifier: 1985081
2026-03-26 21:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 222757f4-4695-5bb3-961f-07cc7ae01a95 with identifier: 1985081 to the API
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '222757f4-4695-5bb3-961f-07cc7ae01a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 85047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222757f4-4695-5bb3-961f-07cc7ae01a95/222757f4-4695-5bb3-961f-07cc7ae01a95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-h/5b9f21a7bcf745e3ab9acf88e959e2a3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 210 L2 S&S Trend Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 210 L2 S&S Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985081%27 HTTP/1.1" 200 None
2026-03-26 21:46:59 [ayvens.de] INFO: Saving data for 1985081: {'created_time': 1774561619.766576, 'last_price_update_time': 1774561619.766586, 'auction_closing_time': 1774620000.0}
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985081') HTTP/1.1" 204 0
2026-03-26 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8c2490>
2026-03-26 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr%25C3%25BCd%252Fcda691b014e9458cbe71333b3b5f2f8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/7.jpg saved to cache
2026-03-26 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572
2026-03-26 21:46:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572, skipping ID generation
2026-03-26 21:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with scrape type 1
2026-03-26 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 sending to next pipeline
2026-03-26 21:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572, identifier: 1985080
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with identifier: 1985080
2026-03-26 21:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with identifier: 1985080
2026-03-26 21:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6d5cec80-5f1b-5d72-a6ce-e1491c21f572 with identifier: 1985080 to the API
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d5cec80-5f1b-5d72-a6ce-e1491c21f572',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 41109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 878798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 905787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d5cec80-5f1b-5d72-a6ce-e1491c21f572/6d5cec80-5f1b-5d72-a6ce-e1491c21f572_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r%C3%BCd/cda691b014e9458cbe71333b3b5f2f8a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 330 L2H2 VA MH Trend Kombi, 4-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 330 L2H2 VA MH Trend Kombi, 4-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985080%27 HTTP/1.1" 200 None
2026-03-26 21:47:00 [ayvens.de] INFO: Saving data for 1985080: {'created_time': 1774561620.387249, 'last_price_update_time': 1774561620.387259, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985080') HTTP/1.1" 204 0
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69daa5290>
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/8.jpg saved to cache
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9afd50>
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/6.jpg saved to cache
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6c5410>
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/7.jpg saved to cache
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1b8e90>
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/7.jpg saved to cache
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d719f10>
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252F8c9175fa4e0c40a9aace093cd6f83d03%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/8.jpg saved to cache
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26
2026-03-26 21:47:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10a68f3a-8457-5a50-aa98-c569f9b5eb26, skipping ID generation
2026-03-26 21:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with scrape type 1
2026-03-26 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10a68f3a-8457-5a50-aa98-c569f9b5eb26 sending to next pipeline
2026-03-26 21:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 10a68f3a-8457-5a50-aa98-c569f9b5eb26, identifier: 1985079
2026-03-26 21:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with identifier: 1985079
2026-03-26 21:47:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with identifier: 1985079
2026-03-26 21:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 10a68f3a-8457-5a50-aa98-c569f9b5eb26 with identifier: 1985079 to the API
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '10a68f3a-8457-5a50-aa98-c569f9b5eb26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-Max',
 'odometer': 104332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a68f3a-8457-5a50-aa98-c569f9b5eb26/10a68f3a-8457-5a50-aa98-c569f9b5eb26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/8c9175fa4e0c40a9aace093cd6f83d03/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-Max FORD S-Max 2.0 EcoBlue Aut. ST-LINE Kombi, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD S-Max 2.0 EcoBlue Aut. ST-LINE Kombi, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985079%27 HTTP/1.1" 200 None
2026-03-26 21:47:01 [ayvens.de] INFO: Saving data for 1985079: {'created_time': 1774561621.381728, 'last_price_update_time': 1774561621.381738, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985079') HTTP/1.1" 204 0
2026-03-26 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d719810>
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Fb83c780680794821b6d28d8c4668121d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/7.jpg saved to cache
2026-03-26 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bec6cd04-ca05-5d98-b409-930668da2d5c
2026-03-26 21:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bec6cd04-ca05-5d98-b409-930668da2d5c, skipping ID generation
2026-03-26 21:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec6cd04-ca05-5d98-b409-930668da2d5c with scrape type 1
2026-03-26 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bec6cd04-ca05-5d98-b409-930668da2d5c sending to next pipeline
2026-03-26 21:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bec6cd04-ca05-5d98-b409-930668da2d5c, identifier: 1985077
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d7ba750>
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdu-%252Fcc34b93317f2440db829c6e5cf78b0e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/6.jpg saved to cache
2026-03-26 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2c77922-6434-5190-8c82-19756285b05d
2026-03-26 21:47:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2c77922-6434-5190-8c82-19756285b05d, skipping ID generation
2026-03-26 21:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c77922-6434-5190-8c82-19756285b05d with scrape type 1
2026-03-26 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2c77922-6434-5190-8c82-19756285b05d sending to next pipeline
2026-03-26 21:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e2c77922-6434-5190-8c82-19756285b05d, identifier: 1985078
2026-03-26 21:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bec6cd04-ca05-5d98-b409-930668da2d5c with identifier: 1985077
2026-03-26 21:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bec6cd04-ca05-5d98-b409-930668da2d5c with identifier: 1985077
2026-03-26 21:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bec6cd04-ca05-5d98-b409-930668da2d5c with identifier: 1985077 to the API
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'na',
 'id': 'bec6cd04-ca05-5d98-b409-930668da2d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 31919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec6cd04-ca05-5d98-b409-930668da2d5c/bec6cd04-ca05-5d98-b409-930668da2d5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/b83c780680794821b6d28d8c4668121d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM X '
          'Geschlossen, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985077%27 HTTP/1.1" 200 None
2026-03-26 21:47:02 [ayvens.de] INFO: Saving data for 1985077: {'created_time': 1774561622.530472, 'last_price_update_time': 1774561622.530486, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985077') HTTP/1.1" 204 0
2026-03-26 21:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e2c77922-6434-5190-8c82-19756285b05d with identifier: 1985078
2026-03-26 21:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e2c77922-6434-5190-8c82-19756285b05d with identifier: 1985078
2026-03-26 21:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e2c77922-6434-5190-8c82-19756285b05d with identifier: 1985078 to the API
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e2c77922-6434-5190-8c82-19756285b05d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Ranger',
 'odometer': 70021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c77922-6434-5190-8c82-19756285b05d/e2c77922-6434-5190-8c82-19756285b05d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/du-/cc34b93317f2440db829c6e5cf78b0e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Ranger FORD Ranger 2,0 l EcoBlue Doppelkabine Autm. Wildtrak '
          'Doppelk.Pritsche, 4-türig, Automatik, 10-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Ranger 2,0 l EcoBlue Doppelkabine Autm. Wildtrak '
         'Doppelk.Pritsche, 4-türig, Automatik, 10-Gang',
 'vin': None,
 'year': 2023}
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985078%27 HTTP/1.1" 200 None
2026-03-26 21:47:03 [ayvens.de] INFO: Saving data for 1985078: {'created_time': 1774561623.011957, 'last_price_update_time': 1774561623.01197, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985078') HTTP/1.1" 204 0
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1a8bd0>
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh%25C3%25B6s%252Fadda8e2c3cfc4e99b82b681e69c914ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/7.jpg saved to cache
2026-03-26 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 374d39d6-e687-538b-99df-e7f5b3b495fd
2026-03-26 21:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 374d39d6-e687-538b-99df-e7f5b3b495fd, skipping ID generation
2026-03-26 21:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374d39d6-e687-538b-99df-e7f5b3b495fd with scrape type 1
2026-03-26 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 374d39d6-e687-538b-99df-e7f5b3b495fd sending to next pipeline
2026-03-26 21:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 374d39d6-e687-538b-99df-e7f5b3b495fd, identifier: 1985076
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d1aa010>
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/4.jpg saved to cache
2026-03-26 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 374d39d6-e687-538b-99df-e7f5b3b495fd with identifier: 1985076
2026-03-26 21:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 374d39d6-e687-538b-99df-e7f5b3b495fd with identifier: 1985076
2026-03-26 21:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 374d39d6-e687-538b-99df-e7f5b3b495fd with identifier: 1985076 to the API
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '374d39d6-e687-538b-99df-e7f5b3b495fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Mustang Mach-E',
 'odometer': 28700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374d39d6-e687-538b-99df-e7f5b3b495fd/374d39d6-e687-538b-99df-e7f5b3b495fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h%C3%B6s/adda8e2c3cfc4e99b82b681e69c914ca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Mustang Mach-E FORD Mustang Mach-E Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'FORD Mustang Mach-E Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985076%27 HTTP/1.1" 200 None
2026-03-26 21:47:03 [ayvens.de] INFO: Saving data for 1985076: {'created_time': 1774561623.857902, 'last_price_update_time': 1774561623.857911, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985076') HTTP/1.1" 204 0
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8daa10>
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/3.jpg saved to cache
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f700cd0>
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252F388e531fc1a64782890700014d724156%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/2.jpg saved to cache
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae4ab858-e210-5cda-b979-7136ade3a9a4
2026-03-26 21:47:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae4ab858-e210-5cda-b979-7136ade3a9a4, skipping ID generation
2026-03-26 21:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae4ab858-e210-5cda-b979-7136ade3a9a4 with scrape type 1
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae4ab858-e210-5cda-b979-7136ade3a9a4 sending to next pipeline
2026-03-26 21:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ae4ab858-e210-5cda-b979-7136ade3a9a4, identifier: 1985074
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d99ab50>
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fa07eac647d634b1b98e9e56fc8e31900%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/1.jpg saved to cache
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea
2026-03-26 21:47:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea, skipping ID generation
2026-03-26 21:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with scrape type 1
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea sending to next pipeline
2026-03-26 21:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea, identifier: 1985073
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f717910>
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/3.jpg saved to cache
2026-03-26 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d925250>
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frt-%252F0c5389bacb0e4d089d07656b1c937381%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/2.jpg saved to cache
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18ff01f4-8956-544e-ada0-27e1ec8ed875
2026-03-26 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18ff01f4-8956-544e-ada0-27e1ec8ed875, skipping ID generation
2026-03-26 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 with scrape type 1
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18ff01f4-8956-544e-ada0-27e1ec8ed875 sending to next pipeline
2026-03-26 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 18ff01f4-8956-544e-ada0-27e1ec8ed875, identifier: 1985072
2026-03-26 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9ad110>
2026-03-26 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Feff4b31a440241e19e281fe6932fb19d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/7.jpg saved to cache
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 767299f6-8cca-5f67-b565-c9b9c0a55613
2026-03-26 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 767299f6-8cca-5f67-b565-c9b9c0a55613, skipping ID generation
2026-03-26 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767299f6-8cca-5f67-b565-c9b9c0a55613 with scrape type 1
2026-03-26 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 767299f6-8cca-5f67-b565-c9b9c0a55613 sending to next pipeline
2026-03-26 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 767299f6-8cca-5f67-b565-c9b9c0a55613, identifier: 1985069
2026-03-26 21:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ae4ab858-e210-5cda-b979-7136ade3a9a4 with identifier: 1985074
2026-03-26 21:47:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ae4ab858-e210-5cda-b979-7136ade3a9a4 with identifier: 1985074
2026-03-26 21:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ae4ab858-e210-5cda-b979-7136ade3a9a4 with identifier: 1985074 to the API
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ae4ab858-e210-5cda-b979-7136ade3a9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 67860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae4ab858-e210-5cda-b979-7136ade3a9a4/ae4ab858-e210-5cda-b979-7136ade3a9a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/388e531fc1a64782890700014d724156/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985074%27 HTTP/1.1" 200 None
2026-03-26 21:47:06 [ayvens.de] INFO: Saving data for 1985074: {'created_time': 1774561626.09971, 'last_price_update_time': 1774561626.099723, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985074') HTTP/1.1" 204 0
2026-03-26 21:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with identifier: 1985073
2026-03-26 21:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with identifier: 1985073
2026-03-26 21:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 09ceade6-a96b-5e63-8e83-a6dcc5bea3ea with identifier: 1985073 to the API
2026-03-26 21:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '09ceade6-a96b-5e63-8e83-a6dcc5bea3ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 87272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ceade6-a96b-5e63-8e83-a6dcc5bea3ea/09ceade6-a96b-5e63-8e83-a6dcc5bea3ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/a07eac647d634b1b98e9e56fc8e31900/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985073%27 HTTP/1.1" 200 None
2026-03-26 21:47:07 [ayvens.de] INFO: Saving data for 1985073: {'created_time': 1774561627.137318, 'last_price_update_time': 1774561627.137328, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985073') HTTP/1.1" 204 0
2026-03-26 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1985072
2026-03-26 21:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1985072
2026-03-26 21:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 18ff01f4-8956-544e-ada0-27e1ec8ed875 with identifier: 1985072 to the API
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '18ff01f4-8956-544e-ada0-27e1ec8ed875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 126506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ff01f4-8956-544e-ada0-27e1ec8ed875/18ff01f4-8956-544e-ada0-27e1ec8ed875_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rt-/0c5389bacb0e4d089d07656b1c937381/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985072%27 HTTP/1.1" 200 None
2026-03-26 21:47:07 [ayvens.de] INFO: Saving data for 1985072: {'created_time': 1774561627.645875, 'last_price_update_time': 1774561627.645886, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985072') HTTP/1.1" 204 0
2026-03-26 21:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 767299f6-8cca-5f67-b565-c9b9c0a55613 with identifier: 1985069
2026-03-26 21:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 767299f6-8cca-5f67-b565-c9b9c0a55613 with identifier: 1985069
2026-03-26 21:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 767299f6-8cca-5f67-b565-c9b9c0a55613 with identifier: 1985069 to the API
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': '767299f6-8cca-5f67-b565-c9b9c0a55613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 41263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767299f6-8cca-5f67-b565-c9b9c0a55613/767299f6-8cca-5f67-b565-c9b9c0a55613_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/eff4b31a440241e19e281fe6932fb19d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985069%27 HTTP/1.1" 200 None
2026-03-26 21:47:08 [ayvens.de] INFO: Saving data for 1985069: {'created_time': 1774561628.056905, 'last_price_update_time': 1774561628.056917, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985069') HTTP/1.1" 204 0
2026-03-26 21:47:08 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 3 pages/min), scraped 50 items (at 34 items/min)
2026-03-26 21:47:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f714a50>
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/9.jpg saved to cache
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f752250>
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpe-%252F654733a7956646588db4bc9f2626d078%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/6.jpg saved to cache
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c825ac74-5ed9-526b-8583-6b8f95739447
2026-03-26 21:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c825ac74-5ed9-526b-8583-6b8f95739447, skipping ID generation
2026-03-26 21:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c825ac74-5ed9-526b-8583-6b8f95739447 with scrape type 1
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c825ac74-5ed9-526b-8583-6b8f95739447 sending to next pipeline
2026-03-26 21:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: c825ac74-5ed9-526b-8583-6b8f95739447, identifier: 1985058
2026-03-26 21:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: c825ac74-5ed9-526b-8583-6b8f95739447 with identifier: 1985058
2026-03-26 21:47:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: c825ac74-5ed9-526b-8583-6b8f95739447 with identifier: 1985058
2026-03-26 21:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: c825ac74-5ed9-526b-8583-6b8f95739447 with identifier: 1985058 to the API
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schneewei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'c825ac74-5ed9-526b-8583-6b8f95739447',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 38809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c825ac74-5ed9-526b-8583-6b8f95739447/c825ac74-5ed9-526b-8583-6b8f95739447_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pe-/654733a7956646588db4bc9f2626d078/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985058%27 HTTP/1.1" 200 None
2026-03-26 21:47:08 [ayvens.de] INFO: Saving data for 1985058: {'created_time': 1774561628.701078, 'last_price_update_time': 1774561628.701089, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985058') HTTP/1.1" 204 0
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f742a10>
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/8.jpg saved to cache
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d166ad0>
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/7.jpg saved to cache
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f752650>
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_5.jpg HTTP/1.1" 201 0
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhb-%252F082f38ea62fd47a6a10df5c05a2c1896%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/6.jpg saved to cache
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d280347e-f451-538e-a7b7-303054cbad86
2026-03-26 21:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d280347e-f451-538e-a7b7-303054cbad86, skipping ID generation
2026-03-26 21:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d280347e-f451-538e-a7b7-303054cbad86 with scrape type 1
2026-03-26 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d280347e-f451-538e-a7b7-303054cbad86 sending to next pipeline
2026-03-26 21:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d280347e-f451-538e-a7b7-303054cbad86, identifier: 1985057
2026-03-26 21:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d280347e-f451-538e-a7b7-303054cbad86 with identifier: 1985057
2026-03-26 21:47:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d280347e-f451-538e-a7b7-303054cbad86 with identifier: 1985057
2026-03-26 21:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d280347e-f451-538e-a7b7-303054cbad86 with identifier: 1985057 to the API
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd280347e-f451-538e-a7b7-303054cbad86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 91283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d280347e-f451-538e-a7b7-303054cbad86/d280347e-f451-538e-a7b7-303054cbad86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hb-/082f38ea62fd47a6a10df5c05a2c1896/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 CRDi (48V Mild-Hybrid) DCT7 GT Line Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985057%27 HTTP/1.1" 200 None
2026-03-26 21:47:09 [ayvens.de] INFO: Saving data for 1985057: {'created_time': 1774561629.426369, 'last_price_update_time': 1774561629.42638, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985057') HTTP/1.1" 204 0
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f733a50>
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/4.jpg saved to cache
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d10af50>
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252Fca41540de67b498883baf92f36282440%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/3.jpg saved to cache
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f61061d5-b02f-5a06-9fae-2f2407055e5e
2026-03-26 21:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f61061d5-b02f-5a06-9fae-2f2407055e5e, skipping ID generation
2026-03-26 21:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61061d5-b02f-5a06-9fae-2f2407055e5e with scrape type 1
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f61061d5-b02f-5a06-9fae-2f2407055e5e sending to next pipeline
2026-03-26 21:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f61061d5-b02f-5a06-9fae-2f2407055e5e, identifier: 1985054
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9f5b10>
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/10.jpg saved to cache
2026-03-26 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d858250>
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/9.jpg saved to cache
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7160d0>
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/8.jpg saved to cache
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d6dea10>
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252Fb82b099696874c8a87f567e715289e7f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/7.jpg saved to cache
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3
2026-03-26 21:47:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, skipping ID generation
2026-03-26 21:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with scrape type 1
2026-03-26 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6d4fbc8-7897-53cb-88cc-9c02768efdf3 sending to next pipeline
2026-03-26 21:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e6d4fbc8-7897-53cb-88cc-9c02768efdf3, identifier: 1985053
2026-03-26 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1985054
2026-03-26 21:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1985054
2026-03-26 21:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f61061d5-b02f-5a06-9fae-2f2407055e5e with identifier: 1985054 to the API
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f61061d5-b02f-5a06-9fae-2f2407055e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 37443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 959751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f61061d5-b02f-5a06-9fae-2f2407055e5e/f61061d5-b02f-5a06-9fae-2f2407055e5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/ca41540de67b498883baf92f36282440/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985054%27 HTTP/1.1" 200 None
2026-03-26 21:47:10 [ayvens.de] INFO: Saving data for 1985054: {'created_time': 1774561630.601749, 'last_price_update_time': 1774561630.60176, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985054') HTTP/1.1" 204 0
2026-03-26 21:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1985053
2026-03-26 21:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1985053
2026-03-26 21:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e6d4fbc8-7897-53cb-88cc-9c02768efdf3 with identifier: 1985053 to the API
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e6d4fbc8-7897-53cb-88cc-9c02768efdf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 63566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d4fbc8-7897-53cb-88cc-9c02768efdf3/e6d4fbc8-7897-53cb-88cc-9c02768efdf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/b82b099696874c8a87f567e715289e7f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985053%27 HTTP/1.1" 200 None
2026-03-26 21:47:10 [ayvens.de] INFO: Saving data for 1985053: {'created_time': 1774561630.961417, 'last_price_update_time': 1774561630.961426, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985053') HTTP/1.1" 204 0
2026-03-26 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d719fd0>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/5.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d691b50>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/3.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f7429d0>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/9.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d8e0ed0>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/4.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d962390>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/8.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f716810>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/8.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d9c1950>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252F7221407e8bff4abf831a6ad80465f1ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/7.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-26 21:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11342670-1c07-51fa-9975-7777a82b441e, skipping ID generation
2026-03-26 21:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11342670-1c07-51fa-9975-7777a82b441e sending to next pipeline
2026-03-26 21:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11342670-1c07-51fa-9975-7777a82b441e, identifier: 1985051
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f5b2390>
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F8e92ae82ace64657b3f97b09094654d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/2.jpg saved to cache
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-26 21:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9ac5b8f-83b7-5935-9efe-bd6038786488, skipping ID generation
2026-03-26 21:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-26 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9ac5b8f-83b7-5935-9efe-bd6038786488 sending to next pipeline
2026-03-26 21:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9ac5b8f-83b7-5935-9efe-bd6038786488, identifier: 1985052
2026-03-26 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1985051
2026-03-26 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1985051
2026-03-26 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1985051 to the API
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11342670-1c07-51fa-9975-7777a82b441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 109877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/7221407e8bff4abf831a6ad80465f1ba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS '
          'Kombi, 5-türig, Automatik, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS Kombi, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985051%27 HTTP/1.1" 200 None
2026-03-26 21:47:12 [ayvens.de] INFO: Saving data for 1985051: {'created_time': 1774561632.331612, 'last_price_update_time': 1774561632.331623, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985051') HTTP/1.1" 204 0
2026-03-26 21:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1985052
2026-03-26 21:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1985052
2026-03-26 21:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1985052 to the API
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9ac5b8f-83b7-5935-9efe-bd6038786488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 43283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/8e92ae82ace64657b3f97b09094654d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985052%27 HTTP/1.1" 200 None
2026-03-26 21:47:12 [ayvens.de] INFO: Saving data for 1985052: {'created_time': 1774561632.646889, 'last_price_update_time': 1774561632.646898, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985052') HTTP/1.1" 204 0
2026-03-26 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc12450>
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_8.jpg HTTP/1.1" 201 0
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/9.jpg saved to cache
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69fd2dc10>
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg HTTP/1.1" 201 0
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/2.jpg saved to cache
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69dc12750>
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F2024c0f6c1504bd1b4a4106c5a9a4ef9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/1.jpg saved to cache
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-26 21:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e43e99e6-fda1-5f2a-bce1-1804c47092dd, skipping ID generation
2026-03-26 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-26 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e43e99e6-fda1-5f2a-bce1-1804c47092dd sending to next pipeline
2026-03-26 21:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e43e99e6-fda1-5f2a-bce1-1804c47092dd, identifier: 1985049
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa68f72bf10>
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_9.jpg HTTP/1.1" 201 0
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/10.jpg saved to cache
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1985049
2026-03-26 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1985049
2026-03-26 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1985049 to the API
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e43e99e6-fda1-5f2a-bce1-1804c47092dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 48484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/2024c0f6c1504bd1b4a4106c5a9a4ef9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985049%27 HTTP/1.1" 200 None
2026-03-26 21:47:13 [ayvens.de] INFO: Saving data for 1985049: {'created_time': 1774561633.460787, 'last_price_update_time': 1774561633.460798, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985049') HTTP/1.1" 204 0
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69d14a610>
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_7.jpg HTTP/1.1" 201 0
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/8.jpg saved to cache
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa69f2efc50>
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_6.jpg HTTP/1.1" 201 0
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fe5f6b716523b4455b37180d872792cde%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/7.jpg saved to cache
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d0b11ee-57df-5dad-930b-9ad6cb904314
2026-03-26 21:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d0b11ee-57df-5dad-930b-9ad6cb904314, skipping ID generation
2026-03-26 21:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 with scrape type 1
2026-03-26 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d0b11ee-57df-5dad-930b-9ad6cb904314 sending to next pipeline
2026-03-26 21:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 1d0b11ee-57df-5dad-930b-9ad6cb904314, identifier: 1985048
2026-03-26 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1985048
2026-03-26 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1985048
2026-03-26 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 1d0b11ee-57df-5dad-930b-9ad6cb904314 with identifier: 1985048 to the API
2026-03-26 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 21:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d0b11ee-57df-5dad-930b-9ad6cb904314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41068',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 29241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d0b11ee-57df-5dad-930b-9ad6cb904314/1d0b11ee-57df-5dad-930b-9ad6cb904314_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/e5f6b716523b4455b37180d872792cde/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo BLUE dCi 80 START Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271985048%27 HTTP/1.1" 200 None
2026-03-26 21:47:14 [ayvens.de] INFO: Saving data for 1985048: {'created_time': 1774561634.115354, 'last_price_update_time': 1774561634.115363, 'auction_closing_time': 1774620000.0}
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1985048') HTTP/1.1" 204 0
2026-03-26 21:47:14 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 21:47:14 [ayvens.de] INFO: ayvens.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 7, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20last_price_update_time%20lt%201774129634 HTTP/1.1" 200 None
2026-03-26 21:47:14 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (58 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.de/task_43_2026-03-26T21_45_00.jl
2026-03-26 21:47:14 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 271678,
 'downloader/request_count': 583,
 'downloader/request_method_count/GET': 581,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 410404457,
 'downloader/response_count': 583,
 'downloader/response_status_count/200': 583,
 'elapsed_time_seconds': 127.676752,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 21, 47, 14, 254904, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 58,
 'log_count/DEBUG': 4946,
 'log_count/INFO': 4903,
 'memusage/max': 193777664,
 'memusage/startup': 149991424,
 'photo_download_count': 580,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 128,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 124,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 2,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 22,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 109,
 'playwright/response_count/method/GET': 106,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 6,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 583,
 'scheduler/dequeued/memory': 583,
 'scheduler/enqueued': 583,
 'scheduler/enqueued/memory': 583,
 'scrape_type/new': 58,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 2,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.2809366220608354,
 'scrapy-zyte-api/mean_response_seconds': 2.346870399080217,
 'scrapy-zyte-api/processed': 2,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/url': 2,
 'scrapy-zyte-api/status_codes/200': 2,
 'scrapy-zyte-api/success': 2,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 21, 45, 6, 578152, tzinfo=datetime.timezone.utc)}
2026-03-26 21:47:14 [scrapy.core.engine] INFO: Spider closed (finished)