2026-03-24 21:45:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-24 21:45:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-24 21:45:05 [ayvens.de] INFO: Starting spider ayvens.de
2026-03-24 21:45:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-24 21:45:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-24 21:45:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-24 21:45:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-24 21:45:05 [scrapy.extensions.telnet] INFO: Telnet Password: ca73ade6cc97388b
2026-03-24 21:45:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-24 21:45:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.de/task_43_2026-03-24T21_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-24 21:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 21:45:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 21:45:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-24 21:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-24 21:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-24 21:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-24 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 21:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-24 21:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-24 21:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-24 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-24 21:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-24 21:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-24 21:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-24 21:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-24 21:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-24 21:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-24 21:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-24 21:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-24 21:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-24 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 21:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 21:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-24 21:45:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-24 21:45:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-24 21:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-24 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 21:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-24 21:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-24 21:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-24 21:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:17 [ayvens.de] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'CAyp0Y2SqV+27qhwFCW3Xn|2026-03-24T21:45:15.632Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805924715, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'tkwr9T9VtL0ERH2+M0JBwM|1774388717045|1774388717045', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774390517, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-24 21:45:17 [ayvens.de] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'CAyp0Y2SqV+27qhwFCW3Xn|2026-03-24T21:45:15.632Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'tkwr9T9VtL0ERH2+M0JBwM|1774388717045|1774388717045', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-24 21:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-24 21:45:17 [ayvens.de] INFO: Intercepting token...
2026-03-24 21:45:17 [ayvens.de] INFO: Scrolling element to trigger lazy load...
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:17 [ayvens.de] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://api-carmarket.ayvens.com/graphql/saleevents>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 21:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-24 21:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-24 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-24 21:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 21:45:19 [ayvens.de] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-24 21:45:19 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-24 21:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 21:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 21:45:21 [ayvens.de] INFO: Found listing with ID: 1980131
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980131%27 HTTP/1.1" 200 None
2026-03-24 21:45:21 [ayvens.de] INFO: Scrape type for 1980131: 1
2026-03-24 21:45:21 [ayvens.de] INFO: Extracting data for car ID: 1980131
2026-03-24 21:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 050fac18-9d64-54df-9f4b-180d606903be with identifier: 1980131
2026-03-24 21:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050fac18-9d64-54df-9f4b-180d606903be with scrape type 1
2026-03-24 21:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/1.jpg not downloaded yet
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/2.jpg not downloaded yet
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/3.jpg not downloaded yet
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/4.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/5.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/6.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/7.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/8.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/9.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/10.jpg not downloaded yet
2026-03-24 21:45:22 [ayvens.de] INFO: Found listing with ID: 1980132
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980132%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [ayvens.de] INFO: Scrape type for 1980132: 1
2026-03-24 21:45:22 [ayvens.de] INFO: Extracting data for car ID: 1980132
2026-03-24 21:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037178ef-93a0-56df-8617-44612396491d with identifier: 1980132
2026-03-24 21:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037178ef-93a0-56df-8617-44612396491d with scrape type 1
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/1.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/2.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/3.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/4.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/5.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/6.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/7.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/8.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/9.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/10.jpg not downloaded yet
2026-03-24 21:45:22 [ayvens.de] INFO: Found listing with ID: 1980133
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980133%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [ayvens.de] INFO: Scrape type for 1980133: 1
2026-03-24 21:45:22 [ayvens.de] INFO: Extracting data for car ID: 1980133
2026-03-24 21:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with identifier: 1980133
2026-03-24 21:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with scrape type 1
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/1.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/2.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/3.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/4.jpg not downloaded yet
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/5.jpg not downloaded yet
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/6.jpg not downloaded yet
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/7.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/8.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/9.jpg not downloaded yet
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/10.jpg not downloaded yet
2026-03-24 21:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-24 21:45:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-24 21:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3900890>
2026-03-24 21:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-24 21:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/3.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [ayvens.de] INFO: Found listing with ID: 1980134
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980134%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [ayvens.de] INFO: Scrape type for 1980134: 1
2026-03-24 21:45:23 [ayvens.de] INFO: Extracting data for car ID: 1980134
2026-03-24 21:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728fdab9-9201-5793-a237-54af10e1624c with identifier: 1980134
2026-03-24 21:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728fdab9-9201-5793-a237-54af10e1624c with scrape type 1
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/1.jpg not downloaded yet
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/2.jpg not downloaded yet
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aca750>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/4.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7ca10>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/1.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c90710>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/7.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe0410>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/2.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c93e50>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/8.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb0a10>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/6.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c90090>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/5.jpg saved to cache
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/3.jpg not downloaded yet
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/4.jpg not downloaded yet
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/5.jpg not downloaded yet
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/6.jpg not downloaded yet
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/7.jpg not downloaded yet
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/8.jpg not downloaded yet
2026-03-24 21:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c9a250>
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/10.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/9.jpg not downloaded yet
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/10.jpg not downloaded yet
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b57dd0>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/1.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a800d0>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252Fe58bd378cbdb40f8a246a9c55bca2bdd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/9.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 050fac18-9d64-54df-9f4b-180d606903be
2026-03-24 21:45:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 050fac18-9d64-54df-9f4b-180d606903be, skipping ID generation
2026-03-24 21:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050fac18-9d64-54df-9f4b-180d606903be with scrape type 1
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 050fac18-9d64-54df-9f4b-180d606903be sending to next pipeline
2026-03-24 21:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 050fac18-9d64-54df-9f4b-180d606903be, identifier: 1980131
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd2690>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/4.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aa3290>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/2.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9717290>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/5.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b65910>
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/3.jpg saved to cache
2026-03-24 21:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 050fac18-9d64-54df-9f4b-180d606903be with identifier: 1980131
2026-03-24 21:45:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 050fac18-9d64-54df-9f4b-180d606903be with identifier: 1980131
2026-03-24 21:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 050fac18-9d64-54df-9f4b-180d606903be with identifier: 1980131 to the API
2026-03-24 21:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '050fac18-9d64-54df-9f4b-180d606903be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 85390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050fac18-9d64-54df-9f4b-180d606903be/050fac18-9d64-54df-9f4b-180d606903be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/e58bd378cbdb40f8a246a9c55bca2bdd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA AMG MERCEDES-BENZ CLA 250 e Shooting Brake 8G-DCT '
          'Line Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'AMG MERCEDES-BENZ CLA 250 e Shooting Brake 8G-DCT Line Kombi, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980131%27 HTTP/1.1" 200 None
2026-03-24 21:45:25 [ayvens.de] INFO: Saving data for 1980131: {'created_time': 1774388725.541623, 'last_price_update_time': 1774388725.541635, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980131') HTTP/1.1" 204 0
2026-03-24 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:25 [ayvens.de] INFO: Found listing with ID: 1980135
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980135%27 HTTP/1.1" 200 None
2026-03-24 21:45:25 [ayvens.de] INFO: Scrape type for 1980135: 1
2026-03-24 21:45:25 [ayvens.de] INFO: Extracting data for car ID: 1980135
2026-03-24 21:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with identifier: 1980135
2026-03-24 21:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with scrape type 1
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/1.jpg not downloaded yet
2026-03-24 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a385d0>
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/6.jpg saved to cache
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/2.jpg not downloaded yet
2026-03-24 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/3.jpg not downloaded yet
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a12750>
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/4.jpg saved to cache
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a12950>
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/3.jpg saved to cache
2026-03-24 21:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd4050>
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/2.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/4.jpg not downloaded yet
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/5.jpg not downloaded yet
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b393d0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/1.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5ef50>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/10.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/6.jpg not downloaded yet
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/7.jpg not downloaded yet
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/8.jpg not downloaded yet
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a129d0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/5.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39b90>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/9.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/9.jpg not downloaded yet
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/10.jpg not downloaded yet
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2cd50>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/1.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d551d0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/9.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:26 [ayvens.de] INFO: Found listing with ID: 1980136
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980136%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [ayvens.de] INFO: Scrape type for 1980136: 1
2026-03-24 21:45:26 [ayvens.de] INFO: Extracting data for car ID: 1980136
2026-03-24 21:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b58d2437-05a3-5567-a8a4-15688c9bef73 with identifier: 1980136
2026-03-24 21:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b58d2437-05a3-5567-a8a4-15688c9bef73 with scrape type 1
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/1.jpg not downloaded yet
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/2.jpg not downloaded yet
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/3.jpg not downloaded yet
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a3a8d0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/10.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c88dd0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/2.jpg saved to cache
2026-03-24 21:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c308d0>
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/3.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/4.jpg not downloaded yet
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/5.jpg not downloaded yet
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc2750>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/8.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a03350>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/10.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/6.jpg not downloaded yet
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/7.jpg not downloaded yet
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/8.jpg not downloaded yet
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a216d0>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/9.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce1650>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/8.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/9.jpg not downloaded yet
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/10.jpg not downloaded yet
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c07410>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/1.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5a50>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/5.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c99150>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/7.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f7090>
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/6.jpg saved to cache
2026-03-24 21:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:27 [ayvens.de] INFO: Found listing with ID: 1980137
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980137%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [ayvens.de] INFO: Scrape type for 1980137: 1
2026-03-24 21:45:28 [ayvens.de] INFO: Extracting data for car ID: 1980137
2026-03-24 21:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 066a096c-8b10-582c-a749-1e9b6ed147b3 with identifier: 1980137
2026-03-24 21:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066a096c-8b10-582c-a749-1e9b6ed147b3 with scrape type 1
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/1.jpg not downloaded yet
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/2.jpg not downloaded yet
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/3.jpg not downloaded yet
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23310>
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/2.jpg saved to cache
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c04a90>
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/3.jpg saved to cache
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/4.jpg not downloaded yet
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/5.jpg not downloaded yet
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd5f17e90>
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fclp%252Fd34adee8e151445fb15c1c8df50e2e7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/4.jpg saved to cache
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 728fdab9-9201-5793-a237-54af10e1624c
2026-03-24 21:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 728fdab9-9201-5793-a237-54af10e1624c, skipping ID generation
2026-03-24 21:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728fdab9-9201-5793-a237-54af10e1624c with scrape type 1
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 728fdab9-9201-5793-a237-54af10e1624c sending to next pipeline
2026-03-24 21:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 728fdab9-9201-5793-a237-54af10e1624c, identifier: 1980134
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/6.jpg not downloaded yet
2026-03-24 21:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 728fdab9-9201-5793-a237-54af10e1624c with identifier: 1980134
2026-03-24 21:45:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 728fdab9-9201-5793-a237-54af10e1624c with identifier: 1980134
2026-03-24 21:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 728fdab9-9201-5793-a237-54af10e1624c with identifier: 1980134 to the API
2026-03-24 21:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '728fdab9-9201-5793-a237-54af10e1624c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 103215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728fdab9-9201-5793-a237-54af10e1624c/728fdab9-9201-5793-a237-54af10e1624c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/clp/d34adee8e151445fb15c1c8df50e2e7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980134%27 HTTP/1.1" 200 None
2026-03-24 21:45:29 [ayvens.de] INFO: Saving data for 1980134: {'created_time': 1774388729.210271, 'last_price_update_time': 1774388729.210283, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980134') HTTP/1.1" 204 0
2026-03-24 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/7.jpg not downloaded yet
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c33d90>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/8.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9ad6490>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/7.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3902a90>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/4.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a56ad0>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/5.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aa2ed0>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/6.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/8.jpg not downloaded yet
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/9.jpg not downloaded yet
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b40510>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/10.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da9610>
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnm-%252Feadf6a577a184b2aa1e503cbedc709dc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/9.jpg saved to cache
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1
2026-03-24 21:45:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3675abca-3d3e-5621-8bc8-7fe959bf08f1, skipping ID generation
2026-03-24 21:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with scrape type 1
2026-03-24 21:45:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3675abca-3d3e-5621-8bc8-7fe959bf08f1 sending to next pipeline
2026-03-24 21:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3675abca-3d3e-5621-8bc8-7fe959bf08f1, identifier: 1980135
2026-03-24 21:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with identifier: 1980135
2026-03-24 21:45:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with identifier: 1980135
2026-03-24 21:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3675abca-3d3e-5621-8bc8-7fe959bf08f1 with identifier: 1980135 to the API
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3675abca-3d3e-5621-8bc8-7fe959bf08f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 43947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3675abca-3d3e-5621-8bc8-7fe959bf08f1/3675abca-3d3e-5621-8bc8-7fe959bf08f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nm-/eadf6a577a184b2aa1e503cbedc709dc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980135%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [ayvens.de] INFO: Saving data for 1980135: {'created_time': 1774388730.623969, 'last_price_update_time': 1774388730.62398, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980135') HTTP/1.1" 204 0
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/10.jpg not downloaded yet
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [ayvens.de] INFO: Found listing with ID: 1980138
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980138%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [ayvens.de] INFO: Scrape type for 1980138: 1
2026-03-24 21:45:30 [ayvens.de] INFO: Extracting data for car ID: 1980138
2026-03-24 21:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befb7e0f-7246-555b-abff-47f570424eb5 with identifier: 1980138
2026-03-24 21:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befb7e0f-7246-555b-abff-47f570424eb5 with scrape type 1
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/1.jpg not downloaded yet
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/2.jpg not downloaded yet
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/3.jpg not downloaded yet
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/4.jpg not downloaded yet
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/5.jpg not downloaded yet
2026-03-24 21:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdc8d0>
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/3.jpg saved to cache
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/6.jpg not downloaded yet
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/7.jpg not downloaded yet
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/8.jpg not downloaded yet
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc5550>
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/4.jpg saved to cache
2026-03-24 21:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a93910>
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/2.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff6510>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/6.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd0a10>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/5.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff5310>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/1.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff7cd0>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/8.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/9.jpg not downloaded yet
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c770d0>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/7.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/10.jpg not downloaded yet
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [ayvens.de] INFO: Found listing with ID: 1980139
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980139%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [ayvens.de] INFO: Scrape type for 1980139: 1
2026-03-24 21:45:31 [ayvens.de] INFO: Extracting data for car ID: 1980139
2026-03-24 21:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de65a0f7-2a0e-5311-9bb7-f4116e085658 with identifier: 1980139
2026-03-24 21:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de65a0f7-2a0e-5311-9bb7-f4116e085658 with scrape type 1
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/1.jpg not downloaded yet
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/2.jpg not downloaded yet
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/3.jpg not downloaded yet
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/4.jpg not downloaded yet
2026-03-24 21:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/5.jpg not downloaded yet
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/6.jpg not downloaded yet
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a4b550>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/2.jpg saved to cache
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/7.jpg not downloaded yet
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/8.jpg not downloaded yet
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/9.jpg not downloaded yet
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dd9750>
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/9.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ede50>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/4.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ee690>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/3.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d99ad0>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fac-%252F22ec474b390c43bbb62437cc08857b49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/10.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b58d2437-05a3-5567-a8a4-15688c9bef73
2026-03-24 21:45:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b58d2437-05a3-5567-a8a4-15688c9bef73, skipping ID generation
2026-03-24 21:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b58d2437-05a3-5567-a8a4-15688c9bef73 with scrape type 1
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b58d2437-05a3-5567-a8a4-15688c9bef73 sending to next pipeline
2026-03-24 21:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b58d2437-05a3-5567-a8a4-15688c9bef73, identifier: 1980136
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2610>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/8.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc5550>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/7.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cccf90>
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/1.jpg saved to cache
2026-03-24 21:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b58d2437-05a3-5567-a8a4-15688c9bef73 with identifier: 1980136
2026-03-24 21:45:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b58d2437-05a3-5567-a8a4-15688c9bef73 with identifier: 1980136
2026-03-24 21:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b58d2437-05a3-5567-a8a4-15688c9bef73 with identifier: 1980136 to the API
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b58d2437-05a3-5567-a8a4-15688c9bef73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 78540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b58d2437-05a3-5567-a8a4-15688c9bef73/b58d2437-05a3-5567-a8a4-15688c9bef73_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ac-/22ec474b390c43bbb62437cc08857b49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV TITANIUM Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV TITANIUM Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980136%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [ayvens.de] INFO: Saving data for 1980136: {'created_time': 1774388733.020629, 'last_price_update_time': 1774388733.020643, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980136') HTTP/1.1" 204 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/10.jpg not downloaded yet
2026-03-24 21:45:33 [ayvens.de] INFO: Found listing with ID: 1980140
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980140%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [ayvens.de] INFO: Scrape type for 1980140: 1
2026-03-24 21:45:33 [ayvens.de] INFO: Extracting data for car ID: 1980140
2026-03-24 21:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d95e84-59cf-5d75-a080-f082476657f2 with identifier: 1980140
2026-03-24 21:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d95e84-59cf-5d75-a080-f082476657f2 with scrape type 1
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/1.jpg not downloaded yet
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abc9d0>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/10.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/2.jpg not downloaded yet
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/3.jpg not downloaded yet
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/4.jpg not downloaded yet
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/5.jpg not downloaded yet
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/6.jpg not downloaded yet
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/7.jpg not downloaded yet
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/8.jpg not downloaded yet
2026-03-24 21:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c186d0>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/9.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/9.jpg not downloaded yet
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c8aa50>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/7.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ad76d0>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/6.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dcbad0>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/8.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/10.jpg not downloaded yet
2026-03-24 21:45:33 [ayvens.de] INFO: Found listing with ID: 1980141
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980141%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [ayvens.de] INFO: Scrape type for 1980141: 1
2026-03-24 21:45:33 [ayvens.de] INFO: Extracting data for car ID: 1980141
2026-03-24 21:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595962fe-92e9-5493-8aba-c3c90cae3257 with identifier: 1980141
2026-03-24 21:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595962fe-92e9-5493-8aba-c3c90cae3257 with scrape type 1
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/1.jpg not downloaded yet
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba0550>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/1.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e0a410>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/7.jpg saved to cache
2026-03-24 21:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8269490>
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252F824a323d06fb49e4b077e2d3851231dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/5.jpg saved to cache
2026-03-24 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 066a096c-8b10-582c-a749-1e9b6ed147b3
2026-03-24 21:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 066a096c-8b10-582c-a749-1e9b6ed147b3, skipping ID generation
2026-03-24 21:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066a096c-8b10-582c-a749-1e9b6ed147b3 with scrape type 1
2026-03-24 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 066a096c-8b10-582c-a749-1e9b6ed147b3 sending to next pipeline
2026-03-24 21:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 066a096c-8b10-582c-a749-1e9b6ed147b3, identifier: 1980137
2026-03-24 21:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd7406110>
2026-03-24 21:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/10.jpg saved to cache
2026-03-24 21:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 066a096c-8b10-582c-a749-1e9b6ed147b3 with identifier: 1980137
2026-03-24 21:45:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 066a096c-8b10-582c-a749-1e9b6ed147b3 with identifier: 1980137
2026-03-24 21:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 066a096c-8b10-582c-a749-1e9b6ed147b3 with identifier: 1980137 to the API
2026-03-24 21:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '066a096c-8b10-582c-a749-1e9b6ed147b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 46711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_066a096c-8b10-582c-a749-1e9b6ed147b3/066a096c-8b10-582c-a749-1e9b6ed147b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/824a323d06fb49e4b077e2d3851231dd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980137%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [ayvens.de] INFO: Saving data for 1980137: {'created_time': 1774388736.107469, 'last_price_update_time': 1774388736.107481, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980137') HTTP/1.1" 204 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/2.jpg not downloaded yet
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/3.jpg not downloaded yet
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df3550>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/1.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/4.jpg not downloaded yet
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/5.jpg not downloaded yet
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c75c90>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/2.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b66790>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/7.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/6.jpg not downloaded yet
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a4b290>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/9.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/7.jpg not downloaded yet
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a05110>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/6.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c759d0>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/5.jpg saved to cache
2026-03-24 21:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a40250>
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/8.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b41fd0>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/4.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/8.jpg not downloaded yet
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/9.jpg not downloaded yet
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/10.jpg not downloaded yet
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [ayvens.de] INFO: Found listing with ID: 1980142
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980142%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [ayvens.de] INFO: Scrape type for 1980142: 1
2026-03-24 21:45:37 [ayvens.de] INFO: Extracting data for car ID: 1980142
2026-03-24 21:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db74bfd0-1e23-5009-a390-f8d32858c4bf with identifier: 1980142
2026-03-24 21:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db74bfd0-1e23-5009-a390-f8d32858c4bf with scrape type 1
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/1.jpg not downloaded yet
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/2.jpg not downloaded yet
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/3.jpg not downloaded yet
2026-03-24 21:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/4.jpg not downloaded yet
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e14390>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/1.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/5.jpg not downloaded yet
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b67090>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/2.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/6.jpg not downloaded yet
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/7.jpg not downloaded yet
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9717390>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/3.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c86410>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F514f1b72d3144909a092c2fe8948400a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/10.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de65a0f7-2a0e-5311-9bb7-f4116e085658
2026-03-24 21:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de65a0f7-2a0e-5311-9bb7-f4116e085658, skipping ID generation
2026-03-24 21:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de65a0f7-2a0e-5311-9bb7-f4116e085658 with scrape type 1
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de65a0f7-2a0e-5311-9bb7-f4116e085658 sending to next pipeline
2026-03-24 21:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: de65a0f7-2a0e-5311-9bb7-f4116e085658, identifier: 1980139
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd38d0>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/4.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bccd50>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/3.jpg saved to cache
2026-03-24 21:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c85bd0>
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/10.jpg saved to cache
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c59bd0>
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/9.jpg saved to cache
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: de65a0f7-2a0e-5311-9bb7-f4116e085658 with identifier: 1980139
2026-03-24 21:45:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: de65a0f7-2a0e-5311-9bb7-f4116e085658 with identifier: 1980139
2026-03-24 21:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: de65a0f7-2a0e-5311-9bb7-f4116e085658 with identifier: 1980139 to the API
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de65a0f7-2a0e-5311-9bb7-f4116e085658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 93741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de65a0f7-2a0e-5311-9bb7-f4116e085658/de65a0f7-2a0e-5311-9bb7-f4116e085658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/514f1b72d3144909a092c2fe8948400a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo Rapid Maxi Blue dCi 95 Extra Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Maxi Blue dCi 95 Extra Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980139%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [ayvens.de] INFO: Saving data for 1980139: {'created_time': 1774388738.515858, 'last_price_update_time': 1774388738.515871, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980139') HTTP/1.1" 204 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/8.jpg not downloaded yet
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/9.jpg not downloaded yet
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3beecd0>
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/8.jpg saved to cache
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89550>
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/1.jpg saved to cache
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/10.jpg not downloaded yet
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [ayvens.de] INFO: Found listing with ID: 1980143
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980143%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [ayvens.de] INFO: Scrape type for 1980143: 1
2026-03-24 21:45:38 [ayvens.de] INFO: Extracting data for car ID: 1980143
2026-03-24 21:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb31412-7118-5c1a-a428-806d1f50e5e5 with identifier: 1980143
2026-03-24 21:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb31412-7118-5c1a-a428-806d1f50e5e5 with scrape type 1
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/1.jpg not downloaded yet
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcf950>
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/2.jpg saved to cache
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/2.jpg not downloaded yet
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/3.jpg not downloaded yet
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d0690>
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/7.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a3b350>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/6.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c29050>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/5.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/4.jpg not downloaded yet
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/5.jpg not downloaded yet
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/6.jpg not downloaded yet
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc6910>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/3.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc7e50>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/4.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/7.jpg not downloaded yet
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/8.jpg not downloaded yet
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fea1d0>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/8.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b28310>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/9.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/9.jpg not downloaded yet
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/10.jpg not downloaded yet
2026-03-24 21:45:39 [ayvens.de] INFO: Found listing with ID: 1980144
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980144%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [ayvens.de] INFO: Scrape type for 1980144: 1
2026-03-24 21:45:39 [ayvens.de] INFO: Extracting data for car ID: 1980144
2026-03-24 21:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1980144
2026-03-24 21:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/1.jpg not downloaded yet
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a55b50>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/7.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bef790>
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/10.jpg saved to cache
2026-03-24 21:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/2.jpg not downloaded yet
2026-03-24 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/3.jpg not downloaded yet
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcdc90>
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/5.jpg saved to cache
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dab910>
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnr-%252F288362a2c127403f8d98ad2aa92e72cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/6.jpg saved to cache
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 595962fe-92e9-5493-8aba-c3c90cae3257
2026-03-24 21:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595962fe-92e9-5493-8aba-c3c90cae3257, skipping ID generation
2026-03-24 21:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595962fe-92e9-5493-8aba-c3c90cae3257 with scrape type 1
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 595962fe-92e9-5493-8aba-c3c90cae3257 sending to next pipeline
2026-03-24 21:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 595962fe-92e9-5493-8aba-c3c90cae3257, identifier: 1980141
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3dd50>
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/1.jpg saved to cache
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abd3d0>
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/4.jpg saved to cache
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/4.jpg not downloaded yet
2026-03-24 21:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 595962fe-92e9-5493-8aba-c3c90cae3257 with identifier: 1980141
2026-03-24 21:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 595962fe-92e9-5493-8aba-c3c90cae3257 with identifier: 1980141
2026-03-24 21:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 595962fe-92e9-5493-8aba-c3c90cae3257 with identifier: 1980141 to the API
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '595962fe-92e9-5493-8aba-c3c90cae3257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 127708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595962fe-92e9-5493-8aba-c3c90cae3257/595962fe-92e9-5493-8aba-c3c90cae3257_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nr-/288362a2c127403f8d98ad2aa92e72cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio RENAULT Clio Energy dCi 90 Start & Stop LIMITED 2018 '
          'Limousine, 5-türig, 5-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Clio Energy dCi 90 Start & Stop LIMITED 2018 Limousine, '
         '5-türig, 5-Gang',
 'vin': None,
 'year': 2019}
2026-03-24 21:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980141%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [ayvens.de] INFO: Saving data for 1980141: {'created_time': 1774388741.004903, 'last_price_update_time': 1774388741.004914, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980141') HTTP/1.1" 204 0
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/5.jpg not downloaded yet
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/6.jpg not downloaded yet
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a02b90>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/6.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe9590>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/7.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf8750>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/8.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/7.jpg not downloaded yet
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/8.jpg not downloaded yet
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8ce10>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/9.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/9.jpg not downloaded yet
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/10.jpg not downloaded yet
2026-03-24 21:45:41 [ayvens.de] INFO: Found listing with ID: 1980145
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980145%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [ayvens.de] INFO: Scrape type for 1980145: 1
2026-03-24 21:45:41 [ayvens.de] INFO: Extracting data for car ID: 1980145
2026-03-24 21:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb001a3e-3d95-5461-b1a4-4aefd6369987 with identifier: 1980145
2026-03-24 21:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb001a3e-3d95-5461-b1a4-4aefd6369987 with scrape type 1
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/1.jpg not downloaded yet
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c99dd0>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/1.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b28750>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/3.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bce8d0>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/10.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/2.jpg not downloaded yet
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bb8d50>
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252Fc0276570a42f4666a5c5a203f8213780%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/2.jpg saved to cache
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db74bfd0-1e23-5009-a390-f8d32858c4bf
2026-03-24 21:45:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db74bfd0-1e23-5009-a390-f8d32858c4bf, skipping ID generation
2026-03-24 21:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db74bfd0-1e23-5009-a390-f8d32858c4bf with scrape type 1
2026-03-24 21:45:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db74bfd0-1e23-5009-a390-f8d32858c4bf sending to next pipeline
2026-03-24 21:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: db74bfd0-1e23-5009-a390-f8d32858c4bf, identifier: 1980142
2026-03-24 21:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: db74bfd0-1e23-5009-a390-f8d32858c4bf with identifier: 1980142
2026-03-24 21:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: db74bfd0-1e23-5009-a390-f8d32858c4bf with identifier: 1980142
2026-03-24 21:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: db74bfd0-1e23-5009-a390-f8d32858c4bf with identifier: 1980142 to the API
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': 'db74bfd0-1e23-5009-a390-f8d32858c4bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 45681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db74bfd0-1e23-5009-a390-f8d32858c4bf/db74bfd0-1e23-5009-a390-f8d32858c4bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/c0276570a42f4666a5c5a203f8213780/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM X '
          'Geschlossen, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Puma 1.0 EcoBoost Hybrid Aut. TITANIUM X Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980142%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [ayvens.de] INFO: Saving data for 1980142: {'created_time': 1774388742.290738, 'last_price_update_time': 1774388742.290751, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980142') HTTP/1.1" 204 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/3.jpg not downloaded yet
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd2d50>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/3.jpg saved to cache
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc4790>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/4.jpg saved to cache
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bfac50>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/6.jpg saved to cache
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/4.jpg not downloaded yet
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fddd0>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/5.jpg saved to cache
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/5.jpg not downloaded yet
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/6.jpg not downloaded yet
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/7.jpg not downloaded yet
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/8.jpg not downloaded yet
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/9.jpg not downloaded yet
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/10.jpg not downloaded yet
2026-03-24 21:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:42 [ayvens.de] INFO: Found listing with ID: 1980146
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980146%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [ayvens.de] INFO: Scrape type for 1980146: 1
2026-03-24 21:45:42 [ayvens.de] INFO: Extracting data for car ID: 1980146
2026-03-24 21:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5723718e-86bd-5ca8-b913-a36089324c94 with identifier: 1980146
2026-03-24 21:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5723718e-86bd-5ca8-b913-a36089324c94 with scrape type 1
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/1.jpg not downloaded yet
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a55c10>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/7.jpg saved to cache
2026-03-24 21:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a754d0>
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/8.jpg saved to cache
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/2.jpg not downloaded yet
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b083d0>
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/2.jpg saved to cache
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c4d010>
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/9.jpg saved to cache
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf8290>
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fel-%252Fed4ffc9a670840eeab97990987928ccd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/10.jpg saved to cache
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbb31412-7118-5c1a-a428-806d1f50e5e5
2026-03-24 21:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbb31412-7118-5c1a-a428-806d1f50e5e5, skipping ID generation
2026-03-24 21:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb31412-7118-5c1a-a428-806d1f50e5e5 with scrape type 1
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbb31412-7118-5c1a-a428-806d1f50e5e5 sending to next pipeline
2026-03-24 21:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: dbb31412-7118-5c1a-a428-806d1f50e5e5, identifier: 1980143
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/3.jpg not downloaded yet
2026-03-24 21:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: dbb31412-7118-5c1a-a428-806d1f50e5e5 with identifier: 1980143
2026-03-24 21:45:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: dbb31412-7118-5c1a-a428-806d1f50e5e5 with identifier: 1980143
2026-03-24 21:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: dbb31412-7118-5c1a-a428-806d1f50e5e5 with identifier: 1980143 to the API
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'color': 'Frost',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbb31412-7118-5c1a-a428-806d1f50e5e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Ranger',
 'odometer': 122290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbb31412-7118-5c1a-a428-806d1f50e5e5/dbb31412-7118-5c1a-a428-806d1f50e5e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/el-/ed4ffc9a670840eeab97990987928ccd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Ranger FORD Ranger 2,0 l EcoBlue Autm. Wildtrak '
          'Doppelk.Pritsche, 4-türig, Automatik, 10-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Ranger 2,0 l EcoBlue Autm. Wildtrak Doppelk.Pritsche, 4-türig, '
         'Automatik, 10-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980143%27 HTTP/1.1" 200 None
2026-03-24 21:45:43 [ayvens.de] INFO: Saving data for 1980143: {'created_time': 1774388743.889495, 'last_price_update_time': 1774388743.889505, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980143') HTTP/1.1" 204 0
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/4.jpg not downloaded yet
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da8fd0>
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/1.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bfa5d0>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/4.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc6990>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/3.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/5.jpg not downloaded yet
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/6.jpg not downloaded yet
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/7.jpg not downloaded yet
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/8.jpg not downloaded yet
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/9.jpg not downloaded yet
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/10.jpg not downloaded yet
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bfaa90>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/5.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [ayvens.de] INFO: Found listing with ID: 1980147
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980147%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [ayvens.de] INFO: Scrape type for 1980147: 1
2026-03-24 21:45:44 [ayvens.de] INFO: Extracting data for car ID: 1980147
2026-03-24 21:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1cc7fe1-554c-52da-9010-581720aaa05f with identifier: 1980147
2026-03-24 21:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1cc7fe1-554c-52da-9010-581720aaa05f with scrape type 1
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/1.jpg not downloaded yet
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c22050>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/2.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bbcad0>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/8.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ede50>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/9.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/2.jpg not downloaded yet
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/3.jpg not downloaded yet
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a80190>
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhal%252Fefd8ebe475ee46c6bae480928c7a7210%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/5.jpg saved to cache
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44d95e84-59cf-5d75-a080-f082476657f2
2026-03-24 21:45:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44d95e84-59cf-5d75-a080-f082476657f2, skipping ID generation
2026-03-24 21:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d95e84-59cf-5d75-a080-f082476657f2 with scrape type 1
2026-03-24 21:45:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44d95e84-59cf-5d75-a080-f082476657f2 sending to next pipeline
2026-03-24 21:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 44d95e84-59cf-5d75-a080-f082476657f2, identifier: 1980140
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c98510>
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/1.jpg saved to cache
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd23d0>
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/6.jpg saved to cache
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dabe90>
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/10.jpg saved to cache
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 44d95e84-59cf-5d75-a080-f082476657f2 with identifier: 1980140
2026-03-24 21:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 44d95e84-59cf-5d75-a080-f082476657f2 with identifier: 1980140
2026-03-24 21:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 44d95e84-59cf-5d75-a080-f082476657f2 with identifier: 1980140 to the API
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '44d95e84-59cf-5d75-a080-f082476657f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 97330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d95e84-59cf-5d75-a080-f082476657f2/44d95e84-59cf-5d75-a080-f082476657f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hal/efd8ebe475ee46c6bae480928c7a7210/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Blue dCi 95 Extra Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980140%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [ayvens.de] INFO: Saving data for 1980140: {'created_time': 1774388745.72931, 'last_price_update_time': 1774388745.72932, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980140') HTTP/1.1" 204 0
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/4.jpg not downloaded yet
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/5.jpg not downloaded yet
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/6.jpg not downloaded yet
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/7.jpg not downloaded yet
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/8.jpg not downloaded yet
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/9.jpg not downloaded yet
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/10.jpg not downloaded yet
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5e190>
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/5.jpg saved to cache
2026-03-24 21:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f06010>
2026-03-24 21:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/2.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ddb110>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/3.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2e910>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/4.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [ayvens.de] INFO: Found listing with ID: 1980148
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980148%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [ayvens.de] INFO: Scrape type for 1980148: 1
2026-03-24 21:45:46 [ayvens.de] INFO: Extracting data for car ID: 1980148
2026-03-24 21:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b933ad-7c8a-50b3-9b2a-c130d05b739b with identifier: 1980148
2026-03-24 21:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b with scrape type 1
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/1.jpg not downloaded yet
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/2.jpg not downloaded yet
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/3.jpg not downloaded yet
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c60f50>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/6.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b38450>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/7.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c14c10>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/1.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2cd50>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/2.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/4.jpg not downloaded yet
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/5.jpg not downloaded yet
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc2750>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/10.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/6.jpg not downloaded yet
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/7.jpg not downloaded yet
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/8.jpg not downloaded yet
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a18690>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/4.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1b950>
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/1.jpg saved to cache
2026-03-24 21:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/9.jpg not downloaded yet
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/10.jpg not downloaded yet
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ccd610>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/2.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f5bd0>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/10.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc7410>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/3.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf9190>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/5.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc5350>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/9.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [ayvens.de] INFO: Found listing with ID: 1980149
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980149%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [ayvens.de] INFO: Scrape type for 1980149: 1
2026-03-24 21:45:47 [ayvens.de] INFO: Extracting data for car ID: 1980149
2026-03-24 21:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with identifier: 1980149
2026-03-24 21:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with scrape type 1
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/1.jpg not downloaded yet
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/2.jpg not downloaded yet
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/3.jpg not downloaded yet
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/4.jpg not downloaded yet
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a92f10>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/4.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/5.jpg not downloaded yet
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/6.jpg not downloaded yet
2026-03-24 21:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/7.jpg not downloaded yet
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35e3e90>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/3.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd9390>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/7.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5f3d0>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/1.jpg saved to cache
2026-03-24 21:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3c310>
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/6.jpg saved to cache
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/8.jpg not downloaded yet
2026-03-24 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/9.jpg not downloaded yet
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c90610>
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk-a%252F30f9daffdc7f4d94b8d5aa6aa0c27dd9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/8.jpg saved to cache
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5723718e-86bd-5ca8-b913-a36089324c94
2026-03-24 21:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5723718e-86bd-5ca8-b913-a36089324c94, skipping ID generation
2026-03-24 21:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5723718e-86bd-5ca8-b913-a36089324c94 with scrape type 1
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5723718e-86bd-5ca8-b913-a36089324c94 sending to next pipeline
2026-03-24 21:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5723718e-86bd-5ca8-b913-a36089324c94, identifier: 1980146
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd73f8750>
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/10.jpg saved to cache
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e3b110>
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/9.jpg saved to cache
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/10.jpg not downloaded yet
2026-03-24 21:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5723718e-86bd-5ca8-b913-a36089324c94 with identifier: 1980146
2026-03-24 21:45:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5723718e-86bd-5ca8-b913-a36089324c94 with identifier: 1980146
2026-03-24 21:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5723718e-86bd-5ca8-b913-a36089324c94 with identifier: 1980146 to the API
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '5723718e-86bd-5ca8-b913-a36089324c94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 90777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5723718e-86bd-5ca8-b913-a36089324c94/5723718e-86bd-5ca8-b913-a36089324c94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k-a/30f9daffdc7f4d94b8d5aa6aa0c27dd9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 230 L2 Trend Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 230 L2 Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980146%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [ayvens.de] INFO: Saving data for 1980146: {'created_time': 1774388748.92557, 'last_price_update_time': 1774388748.92558, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980146') HTTP/1.1" 204 0
2026-03-24 21:45:48 [ayvens.de] INFO: Found listing with ID: 1980150
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980150%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [ayvens.de] INFO: Scrape type for 1980150: 1
2026-03-24 21:45:48 [ayvens.de] INFO: Extracting data for car ID: 1980150
2026-03-24 21:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with identifier: 1980150
2026-03-24 21:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with scrape type 1
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/1.jpg not downloaded yet
2026-03-24 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/2.jpg not downloaded yet
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ec790>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/3.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da4150>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/2.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/3.jpg not downloaded yet
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/4.jpg not downloaded yet
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a04090>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/8.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a42050>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/5.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/5.jpg not downloaded yet
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/6.jpg not downloaded yet
2026-03-24 21:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/7.jpg not downloaded yet
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a1bcd0>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/8.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d9b410>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/4.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd1c50>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/6.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/8.jpg not downloaded yet
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dca2d0>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/7.jpg saved to cache
2026-03-24 21:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcaa10>
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/10.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/9.jpg not downloaded yet
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dc9510>
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/1.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/10.jpg not downloaded yet
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [ayvens.de] INFO: Found listing with ID: 1980151
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980151%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [ayvens.de] INFO: Scrape type for 1980151: 1
2026-03-24 21:45:50 [ayvens.de] INFO: Extracting data for car ID: 1980151
2026-03-24 21:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1980151
2026-03-24 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72becd66-d34a-5c15-8560-322b276164ff with scrape type 1
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/1.jpg not downloaded yet
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/2.jpg not downloaded yet
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/3.jpg not downloaded yet
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/4.jpg not downloaded yet
2026-03-24 21:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/5.jpg not downloaded yet
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/6.jpg not downloaded yet
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89110>
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252Fd7c74645d4024177b49a9fb1f6b151cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/9.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b
2026-03-24 21:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04b933ad-7c8a-50b3-9b2a-c130d05b739b, skipping ID generation
2026-03-24 21:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b with scrape type 1
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04b933ad-7c8a-50b3-9b2a-c130d05b739b sending to next pipeline
2026-03-24 21:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 04b933ad-7c8a-50b3-9b2a-c130d05b739b, identifier: 1980148
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99f1050>
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/3.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d9b490>
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/2.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd29d0>
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/4.jpg saved to cache
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/7.jpg not downloaded yet
2026-03-24 21:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 04b933ad-7c8a-50b3-9b2a-c130d05b739b with identifier: 1980148
2026-03-24 21:45:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 04b933ad-7c8a-50b3-9b2a-c130d05b739b with identifier: 1980148
2026-03-24 21:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 04b933ad-7c8a-50b3-9b2a-c130d05b739b with identifier: 1980148 to the API
2026-03-24 21:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Polar White Uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '04b933ad-7c8a-50b3-9b2a-c130d05b739b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 59698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b933ad-7c8a-50b3-9b2a-c130d05b739b/04b933ad-7c8a-50b3-9b2a-c130d05b739b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/d7c74645d4024177b49a9fb1f6b151cf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Style Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Style Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980148%27 HTTP/1.1" 200 None
2026-03-24 21:45:51 [ayvens.de] INFO: Saving data for 1980148: {'created_time': 1774388751.762076, 'last_price_update_time': 1774388751.762085, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980148') HTTP/1.1" 204 0
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/8.jpg not downloaded yet
2026-03-24 21:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/9.jpg not downloaded yet
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d25d0>
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/5.jpg saved to cache
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc7590>
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/8.jpg saved to cache
2026-03-24 21:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1d990>
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/7.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc55d0>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/6.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/10.jpg not downloaded yet
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [ayvens.de] INFO: Found listing with ID: 1980152
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980152%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [ayvens.de] INFO: Scrape type for 1980152: 1
2026-03-24 21:45:52 [ayvens.de] INFO: Extracting data for car ID: 1980152
2026-03-24 21:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2befc0-23ac-597b-a8d1-686a2d8489a8 with identifier: 1980152
2026-03-24 21:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2befc0-23ac-597b-a8d1-686a2d8489a8 with scrape type 1
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/1.jpg not downloaded yet
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b29d50>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/10.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/2.jpg not downloaded yet
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/3.jpg not downloaded yet
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/4.jpg not downloaded yet
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f5ed0>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/2.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8c990>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/1.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89f90>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-v%252F37b98e0ca2164529be326e6181c8b20f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/9.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc
2026-03-24 21:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc, skipping ID generation
2026-03-24 21:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with scrape type 1
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e76d99f8-1b86-59e9-a775-6b78bd7ca0dc sending to next pipeline
2026-03-24 21:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc, identifier: 1980149
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a0c050>
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/7.jpg saved to cache
2026-03-24 21:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with identifier: 1980149
2026-03-24 21:45:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with identifier: 1980149
2026-03-24 21:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e76d99f8-1b86-59e9-a775-6b78bd7ca0dc with identifier: 1980149 to the API
2026-03-24 21:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': 'e76d99f8-1b86-59e9-a775-6b78bd7ca0dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 135589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76d99f8-1b86-59e9-a775-6b78bd7ca0dc/e76d99f8-1b86-59e9-a775-6b78bd7ca0dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-v/37b98e0ca2164529be326e6181c8b20f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON HYUNDAI Tucson 1.6 GDi 2WD Pure Geschlossen, '
          '5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Tucson 1.6 GDi 2WD Pure Geschlossen, 5-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980149%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [ayvens.de] INFO: Saving data for 1980149: {'created_time': 1774388753.235633, 'last_price_update_time': 1774388753.235644, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980149') HTTP/1.1" 204 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/5.jpg not downloaded yet
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/6.jpg not downloaded yet
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dcaa90>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/3.jpg saved to cache
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc97202d0>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/6.jpg saved to cache
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c153d0>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/4.jpg saved to cache
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/7.jpg not downloaded yet
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/8.jpg not downloaded yet
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/9.jpg not downloaded yet
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/10.jpg not downloaded yet
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:53 [ayvens.de] INFO: Found listing with ID: 1980153
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980153%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [ayvens.de] INFO: Scrape type for 1980153: 1
2026-03-24 21:45:53 [ayvens.de] INFO: Extracting data for car ID: 1980153
2026-03-24 21:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1980153
2026-03-24 21:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5649e09f-005e-5163-abe0-84bf79057a0c with scrape type 1
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/1.jpg not downloaded yet
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/2.jpg not downloaded yet
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/3.jpg not downloaded yet
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2f790>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/10.jpg saved to cache
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf9b50>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/9.jpg saved to cache
2026-03-24 21:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b2a050>
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/7.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/4.jpg not downloaded yet
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8215b50>
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/8.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/5.jpg not downloaded yet
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/6.jpg not downloaded yet
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2c050>
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/1.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b54310>
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fher%252F623e47c99d0b4fe6938fc50a4d351991%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/5.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e
2026-03-24 21:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e, skipping ID generation
2026-03-24 21:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with scrape type 1
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0d17cef-2579-57b5-87c1-3dc0ceaeed8e sending to next pipeline
2026-03-24 21:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e, identifier: 1980150
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a03c90>
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/7.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39110>
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/6.jpg saved to cache
2026-03-24 21:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with identifier: 1980150
2026-03-24 21:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with identifier: 1980150
2026-03-24 21:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d0d17cef-2579-57b5-87c1-3dc0ceaeed8e with identifier: 1980150 to the API
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd0d17cef-2579-57b5-87c1-3dc0ceaeed8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 50240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d17cef-2579-57b5-87c1-3dc0ceaeed8e/d0d17cef-2579-57b5-87c1-3dc0ceaeed8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/her/623e47c99d0b4fe6938fc50a4d351991/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON HYUNDAI TUCSON 1.6 T-GDi HEV 4WD Prime Geschlossen, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI TUCSON 1.6 T-GDi HEV 4WD Prime Geschlossen, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980150%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [ayvens.de] INFO: Saving data for 1980150: {'created_time': 1774388755.052022, 'last_price_update_time': 1774388755.052032, 'auction_closing_time': 1774447200.0}
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980150') HTTP/1.1" 204 0
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/7.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/8.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/9.jpg not downloaded yet
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/10.jpg not downloaded yet
2026-03-24 21:45:55 [ayvens.de] INFO: Found listing with ID: 1980154
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980154%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [ayvens.de] INFO: Scrape type for 1980154: 1
2026-03-24 21:45:55 [ayvens.de] INFO: Extracting data for car ID: 1980154
2026-03-24 21:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be773b88-6c85-525a-8627-b111ed9e1ef7 with identifier: 1980154
2026-03-24 21:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be773b88-6c85-525a-8627-b111ed9e1ef7 with scrape type 1
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/1.jpg not downloaded yet
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/2.jpg not downloaded yet
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce98d0>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/8.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dd8f10>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/9.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a18410>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/5.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5f050>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/4.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/3.jpg not downloaded yet
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/4.jpg not downloaded yet
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b38d50>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/10.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f7050>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/4.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3c050>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/3.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da45d0>
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/2.jpg saved to cache
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/5.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/6.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/7.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/8.jpg not downloaded yet
2026-03-24 21:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/9.jpg not downloaded yet
2026-03-24 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/10.jpg not downloaded yet
2026-03-24 21:45:56 [ayvens.de] INFO: Found listing with ID: 1980155
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980155%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [ayvens.de] INFO: Scrape type for 1980155: 1
2026-03-24 21:45:56 [ayvens.de] INFO: Extracting data for car ID: 1980155
2026-03-24 21:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with identifier: 1980155
2026-03-24 21:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with scrape type 1
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/1.jpg not downloaded yet
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a74dd0>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/8.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/2.jpg not downloaded yet
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd7b90>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/6.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8fa50>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/7.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2110>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/5.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcc4d0>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/4.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/3.jpg not downloaded yet
2026-03-24 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc8650>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/9.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39710>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/1.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abca50>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/3.jpg saved to cache
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/4.jpg not downloaded yet
2026-03-24 21:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/5.jpg not downloaded yet
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba3650>
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/7.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/6.jpg not downloaded yet
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/7.jpg not downloaded yet
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ecd50>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/3.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/8.jpg not downloaded yet
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/9.jpg not downloaded yet
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/10.jpg not downloaded yet
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b2bcd0>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/6.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcfd90>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/2.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff5310>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/5.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3daae90>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/2.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cea350>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/10.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ab1950>
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/1.jpg saved to cache
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [ayvens.de] INFO: Found listing with ID: 1980156
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980156%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [ayvens.de] INFO: Scrape type for 1980156: 1
2026-03-24 21:45:57 [ayvens.de] INFO: Extracting data for car ID: 1980156
2026-03-24 21:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1980156
2026-03-24 21:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0501d641-c273-501b-a0b3-9e40312e0901 with scrape type 1
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/1.jpg not downloaded yet
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/2.jpg not downloaded yet
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/3.jpg not downloaded yet
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/4.jpg not downloaded yet
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/5.jpg not downloaded yet
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc2b10>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/4.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/6.jpg not downloaded yet
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/7.jpg not downloaded yet
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/8.jpg not downloaded yet
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df2450>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/5.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f67d0>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/8.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fe650>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/9.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2050>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/6.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/9.jpg not downloaded yet
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aca610>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/3.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/10.jpg not downloaded yet
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c129d0>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/7.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe87d0>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/2.jpg saved to cache
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [ayvens.de] INFO: Found listing with ID: 1980157
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980157%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [ayvens.de] INFO: Scrape type for 1980157: 1
2026-03-24 21:45:58 [ayvens.de] INFO: Extracting data for car ID: 1980157
2026-03-24 21:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20e915c-608a-538a-97d9-057670b4571b with identifier: 1980157
2026-03-24 21:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20e915c-608a-538a-97d9-057670b4571b with scrape type 1
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/1.jpg not downloaded yet
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/2.jpg not downloaded yet
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c06290>
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/1.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/3.jpg not downloaded yet
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/4.jpg not downloaded yet
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3c390>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/5.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdf290>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/4.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd0810>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/10.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd4a10>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/9.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/5.jpg not downloaded yet
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/6.jpg not downloaded yet
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/7.jpg not downloaded yet
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c58290>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/8.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3afb250>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/7.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c9ae50>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/6.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/8.jpg not downloaded yet
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/9.jpg not downloaded yet
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c15790>
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/1.jpg saved to cache
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/10.jpg not downloaded yet
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:45:59 [ayvens.de] INFO: Found listing with ID: 1980158
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980158%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [ayvens.de] INFO: Scrape type for 1980158: 1
2026-03-24 21:45:59 [ayvens.de] INFO: Extracting data for car ID: 1980158
2026-03-24 21:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949d85d2-624d-53bc-86b9-021274739298 with identifier: 1980158
2026-03-24 21:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949d85d2-624d-53bc-86b9-021274739298 with scrape type 1
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/1.jpg not downloaded yet
2026-03-24 21:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/2.jpg not downloaded yet
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d55150>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/2.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/3.jpg not downloaded yet
2026-03-24 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/4.jpg not downloaded yet
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce0950>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/3.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d54d50>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/9.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5650>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/4.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/5.jpg not downloaded yet
2026-03-24 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/6.jpg not downloaded yet
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/7.jpg not downloaded yet
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c92310>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/8.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8d250>
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F40b3dfc831534a26b4a2e98a48cd13fa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/10.jpg saved to cache
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1
2026-03-24 21:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1, skipping ID generation
2026-03-24 21:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with scrape type 1
2026-03-24 21:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 sending to next pipeline
2026-03-24 21:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1, identifier: 1980155
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1a090>
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/7.jpg saved to cache
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with identifier: 1980155
2026-03-24 21:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with identifier: 1980155
2026-03-24 21:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 35fda8a0-c3dd-5fc3-80ad-5598902e1de1 with identifier: 1980155 to the API
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '35fda8a0-c3dd-5fc3-80ad-5598902e1de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 60060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fda8a0-c3dd-5fc3-80ad-5598902e1de1/35fda8a0-c3dd-5fc3-80ad-5598902e1de1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/40b3dfc831534a26b4a2e98a48cd13fa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Spirit Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980155%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [ayvens.de] INFO: Saving data for 1980155: {'created_time': 1774388761.681374, 'last_price_update_time': 1774388761.681388, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980155') HTTP/1.1" 204 0
2026-03-24 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/8.jpg not downloaded yet
2026-03-24 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/9.jpg not downloaded yet
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bb2390>
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/6.jpg saved to cache
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a0c590>
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/10.jpg saved to cache
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/10.jpg not downloaded yet
2026-03-24 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:01 [ayvens.de] INFO: Found listing with ID: 1980159
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980159%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [ayvens.de] INFO: Scrape type for 1980159: 1
2026-03-24 21:46:01 [ayvens.de] INFO: Extracting data for car ID: 1980159
2026-03-24 21:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1980159
2026-03-24 21:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with scrape type 1
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/1.jpg not downloaded yet
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c5a990>
2026-03-24 21:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/1.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ddba90>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/9.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/2.jpg not downloaded yet
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/3.jpg not downloaded yet
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b42050>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/5.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc6b10>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/2.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/4.jpg not downloaded yet
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/5.jpg not downloaded yet
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c90710>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-l%252F962980bc407c497993c80f484e586db6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/5.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0501d641-c273-501b-a0b3-9e40312e0901
2026-03-24 21:46:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0501d641-c273-501b-a0b3-9e40312e0901, skipping ID generation
2026-03-24 21:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0501d641-c273-501b-a0b3-9e40312e0901 with scrape type 1
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0501d641-c273-501b-a0b3-9e40312e0901 sending to next pipeline
2026-03-24 21:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0501d641-c273-501b-a0b3-9e40312e0901, identifier: 1980156
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdcc10>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/6.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c9bcd0>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/4.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bce890>
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/7.jpg saved to cache
2026-03-24 21:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1980156
2026-03-24 21:46:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1980156
2026-03-24 21:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0501d641-c273-501b-a0b3-9e40312e0901 with identifier: 1980156 to the API
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0501d641-c273-501b-a0b3-9e40312e0901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 62799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0501d641-c273-501b-a0b3-9e40312e0901/0501d641-c273-501b-a0b3-9e40312e0901_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-l/962980bc407c497993c80f484e586db6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Inspiration '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Inspiration Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980156%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [ayvens.de] INFO: Saving data for 1980156: {'created_time': 1774388763.374731, 'last_price_update_time': 1774388763.37474, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980156') HTTP/1.1" 204 0
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/6.jpg not downloaded yet
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/7.jpg not downloaded yet
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a12990>
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/9.jpg saved to cache
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8268050>
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/10.jpg saved to cache
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/8.jpg not downloaded yet
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/9.jpg not downloaded yet
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/10.jpg not downloaded yet
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [ayvens.de] INFO: Found listing with ID: 1980160
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980160%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [ayvens.de] INFO: Scrape type for 1980160: 1
2026-03-24 21:46:03 [ayvens.de] INFO: Extracting data for car ID: 1980160
2026-03-24 21:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78b6b96-9216-5ca3-b76e-2cc54acbbdce with identifier: 1980160
2026-03-24 21:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce with scrape type 1
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/1.jpg not downloaded yet
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/2.jpg not downloaded yet
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/3.jpg not downloaded yet
2026-03-24 21:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a05fd0>
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/1.jpg saved to cache
2026-03-24 21:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4b90>
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/2.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aa2a10>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/8.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4c10>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/3.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/4.jpg not downloaded yet
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/5.jpg not downloaded yet
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c85d50>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/4.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1a0d0>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/5.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd6e10>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/7.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c17390>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/6.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/6.jpg not downloaded yet
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/7.jpg not downloaded yet
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/8.jpg not downloaded yet
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/9.jpg not downloaded yet
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/10.jpg not downloaded yet
2026-03-24 21:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:04 [ayvens.de] INFO: Found listing with ID: 1980161
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980161%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [ayvens.de] INFO: Scrape type for 1980161: 1
2026-03-24 21:46:04 [ayvens.de] INFO: Extracting data for car ID: 1980161
2026-03-24 21:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26eed75b-d158-5e97-8d4a-6d0c12f883df with identifier: 1980161
2026-03-24 21:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26eed75b-d158-5e97-8d4a-6d0c12f883df with scrape type 1
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/1.jpg not downloaded yet
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/2.jpg not downloaded yet
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2ac10>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/1.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ab3a90>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/8.jpg saved to cache
2026-03-24 21:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1af10>
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/2.jpg saved to cache
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb3d10>
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/9.jpg saved to cache
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/3.jpg not downloaded yet
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da8990>
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fma-%252Fd871d252ab874487a70b5a971922c39f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/3.jpg saved to cache
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a20e915c-608a-538a-97d9-057670b4571b
2026-03-24 21:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a20e915c-608a-538a-97d9-057670b4571b, skipping ID generation
2026-03-24 21:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20e915c-608a-538a-97d9-057670b4571b with scrape type 1
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a20e915c-608a-538a-97d9-057670b4571b sending to next pipeline
2026-03-24 21:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a20e915c-608a-538a-97d9-057670b4571b, identifier: 1980157
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc5bd0>
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhgw%252F49b08a4f822c46e1b5792b6977f8fde8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/10.jpg saved to cache
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 949d85d2-624d-53bc-86b9-021274739298
2026-03-24 21:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 949d85d2-624d-53bc-86b9-021274739298, skipping ID generation
2026-03-24 21:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949d85d2-624d-53bc-86b9-021274739298 with scrape type 1
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 949d85d2-624d-53bc-86b9-021274739298 sending to next pipeline
2026-03-24 21:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 949d85d2-624d-53bc-86b9-021274739298, identifier: 1980158
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/4.jpg not downloaded yet
2026-03-24 21:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a20e915c-608a-538a-97d9-057670b4571b with identifier: 1980157
2026-03-24 21:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a20e915c-608a-538a-97d9-057670b4571b with identifier: 1980157
2026-03-24 21:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a20e915c-608a-538a-97d9-057670b4571b with identifier: 1980157 to the API
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a20e915c-608a-538a-97d9-057670b4571b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 90148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e915c-608a-538a-97d9-057670b4571b/a20e915c-608a-538a-97d9-057670b4571b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ma-/d871d252ab874487a70b5a971922c39f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Spirit Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980157%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [ayvens.de] INFO: Saving data for 1980157: {'created_time': 1774388766.075831, 'last_price_update_time': 1774388766.075841, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980157') HTTP/1.1" 204 0
2026-03-24 21:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 949d85d2-624d-53bc-86b9-021274739298 with identifier: 1980158
2026-03-24 21:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 949d85d2-624d-53bc-86b9-021274739298 with identifier: 1980158
2026-03-24 21:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 949d85d2-624d-53bc-86b9-021274739298 with identifier: 1980158 to the API
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '949d85d2-624d-53bc-86b9-021274739298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 29790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949d85d2-624d-53bc-86b9-021274739298/949d85d2-624d-53bc-86b9-021274739298_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hgw/49b08a4f822c46e1b5792b6977f8fde8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI KONA EV Select Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI KONA EV Select Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980158%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [ayvens.de] INFO: Saving data for 1980158: {'created_time': 1774388766.495891, 'last_price_update_time': 1774388766.495902, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980158') HTTP/1.1" 204 0
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 18 items (at 18 items/min)
2026-03-24 21:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/5.jpg not downloaded yet
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c62f50>
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/4.jpg saved to cache
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c17e50>
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/5.jpg saved to cache
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/6.jpg not downloaded yet
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/7.jpg not downloaded yet
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c286d0>
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/8.jpg saved to cache
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c4ea50>
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/6.jpg saved to cache
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/8.jpg not downloaded yet
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/9.jpg not downloaded yet
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/10.jpg not downloaded yet
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdf510>
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/7.jpg saved to cache
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdf510>
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flip%252Fbc728f69a1cf4a0a9722f9d0c808b9b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/8.jpg saved to cache
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be773b88-6c85-525a-8627-b111ed9e1ef7
2026-03-24 21:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be773b88-6c85-525a-8627-b111ed9e1ef7, skipping ID generation
2026-03-24 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be773b88-6c85-525a-8627-b111ed9e1ef7 with scrape type 1
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be773b88-6c85-525a-8627-b111ed9e1ef7 sending to next pipeline
2026-03-24 21:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: be773b88-6c85-525a-8627-b111ed9e1ef7, identifier: 1980154
2026-03-24 21:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: be773b88-6c85-525a-8627-b111ed9e1ef7 with identifier: 1980154
2026-03-24 21:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: be773b88-6c85-525a-8627-b111ed9e1ef7 with identifier: 1980154
2026-03-24 21:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: be773b88-6c85-525a-8627-b111ed9e1ef7 with identifier: 1980154 to the API
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'be773b88-6c85-525a-8627-b111ed9e1ef7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 56018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be773b88-6c85-525a-8627-b111ed9e1ef7/be773b88-6c85-525a-8627-b111ed9e1ef7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lip/bc728f69a1cf4a0a9722f9d0c808b9b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980154%27 HTTP/1.1" 200 None
2026-03-24 21:46:07 [ayvens.de] INFO: Saving data for 1980154: {'created_time': 1774388767.679734, 'last_price_update_time': 1774388767.679745, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980154') HTTP/1.1" 204 0
2026-03-24 21:46:07 [ayvens.de] INFO: Found listing with ID: 1980162
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980162%27 HTTP/1.1" 200 None
2026-03-24 21:46:07 [ayvens.de] INFO: Scrape type for 1980162: 1
2026-03-24 21:46:07 [ayvens.de] INFO: Extracting data for car ID: 1980162
2026-03-24 21:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a13136-ea01-53ae-a994-b295f4999f66 with identifier: 1980162
2026-03-24 21:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a13136-ea01-53ae-a994-b295f4999f66 with scrape type 1
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/1.jpg not downloaded yet
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/2.jpg not downloaded yet
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a202d0>
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/4.jpg saved to cache
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd2750>
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/9.jpg saved to cache
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c5a6d0>
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/3.jpg saved to cache
2026-03-24 21:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aca350>
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/3.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/3.jpg not downloaded yet
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/4.jpg not downloaded yet
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/5.jpg not downloaded yet
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/6.jpg not downloaded yet
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/7.jpg not downloaded yet
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/8.jpg not downloaded yet
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd5290>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/5.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/9.jpg not downloaded yet
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/10.jpg not downloaded yet
2026-03-24 21:46:08 [ayvens.de] INFO: Found listing with ID: 1980163
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980163%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [ayvens.de] INFO: Scrape type for 1980163: 1
2026-03-24 21:46:08 [ayvens.de] INFO: Extracting data for car ID: 1980163
2026-03-24 21:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9548c26e-8216-513f-afbd-b85961919525 with identifier: 1980163
2026-03-24 21:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9548c26e-8216-513f-afbd-b85961919525 with scrape type 1
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/1.jpg not downloaded yet
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2e810>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/2.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d840d0>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/6.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1d450>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/8.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da9150>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/9.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ca5750>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/3.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d86950>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/1.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc0810>
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/7.jpg saved to cache
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/2.jpg not downloaded yet
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/3.jpg not downloaded yet
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/4.jpg not downloaded yet
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/5.jpg not downloaded yet
2026-03-24 21:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/6.jpg not downloaded yet
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/7.jpg not downloaded yet
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/8.jpg not downloaded yet
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a67bd0>
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/4.jpg saved to cache
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/9.jpg not downloaded yet
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb0f10>
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwl-%252F59a7f3c74d4b4bb492285a8f2caeec3c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/10.jpg saved to cache
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce
2026-03-24 21:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e78b6b96-9216-5ca3-b76e-2cc54acbbdce, skipping ID generation
2026-03-24 21:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce with scrape type 1
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e78b6b96-9216-5ca3-b76e-2cc54acbbdce sending to next pipeline
2026-03-24 21:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e78b6b96-9216-5ca3-b76e-2cc54acbbdce, identifier: 1980160
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c04d50>
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/5.jpg saved to cache
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a57050>
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/8.jpg saved to cache
2026-03-24 21:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdd190>
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/1.jpg saved to cache
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e0b190>
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/6.jpg saved to cache
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c19c50>
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/7.jpg saved to cache
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da85d0>
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/2.jpg saved to cache
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/10.jpg not downloaded yet
2026-03-24 21:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e78b6b96-9216-5ca3-b76e-2cc54acbbdce with identifier: 1980160
2026-03-24 21:46:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e78b6b96-9216-5ca3-b76e-2cc54acbbdce with identifier: 1980160
2026-03-24 21:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e78b6b96-9216-5ca3-b76e-2cc54acbbdce with identifier: 1980160 to the API
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Carrarawei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e78b6b96-9216-5ca3-b76e-2cc54acbbdce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Ceed',
 'odometer': 233306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78b6b96-9216-5ca3-b76e-2cc54acbbdce/e78b6b96-9216-5ca3-b76e-2cc54acbbdce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wl-/59a7f3c74d4b4bb492285a8f2caeec3c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Ceed SW 1.6 GDI DCT OPF Plug-in-Hybrid Vision Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980160%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [ayvens.de] INFO: Saving data for 1980160: {'created_time': 1774388770.710545, 'last_price_update_time': 1774388770.710557, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980160') HTTP/1.1" 204 0
2026-03-24 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:10 [ayvens.de] INFO: Found listing with ID: 1980164
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980164%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [ayvens.de] INFO: Scrape type for 1980164: 1
2026-03-24 21:46:10 [ayvens.de] INFO: Extracting data for car ID: 1980164
2026-03-24 21:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with identifier: 1980164
2026-03-24 21:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with scrape type 1
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/1.jpg not downloaded yet
2026-03-24 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/2.jpg not downloaded yet
2026-03-24 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/3.jpg not downloaded yet
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb49d0>
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/2.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/4.jpg not downloaded yet
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/5.jpg not downloaded yet
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bb8f50>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/4.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3adfa50>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/1.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a74250>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/9.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dd9710>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/3.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/6.jpg not downloaded yet
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/7.jpg not downloaded yet
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/8.jpg not downloaded yet
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3ef10>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/10.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc6dd0>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/1.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e0bbd0>
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/2.jpg saved to cache
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/9.jpg not downloaded yet
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/10.jpg not downloaded yet
2026-03-24 21:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:11 [ayvens.de] INFO: Found listing with ID: 1980165
2026-03-24 21:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980165%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [ayvens.de] INFO: Scrape type for 1980165: 1
2026-03-24 21:46:12 [ayvens.de] INFO: Extracting data for car ID: 1980165
2026-03-24 21:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7864a078-f129-51f5-a393-0a75a5fce65c with identifier: 1980165
2026-03-24 21:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7864a078-f129-51f5-a393-0a75a5fce65c with scrape type 1
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/1.jpg not downloaded yet
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/2.jpg not downloaded yet
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/3.jpg not downloaded yet
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b093d0>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/8.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/4.jpg not downloaded yet
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a4ae50>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/7.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/5.jpg not downloaded yet
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/6.jpg not downloaded yet
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abc6d0>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/3.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd0d50>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/8.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2caf710>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/6.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b55050>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/9.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdcdd0>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/7.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc96db010>
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/10.jpg saved to cache
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/7.jpg not downloaded yet
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/8.jpg not downloaded yet
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/9.jpg not downloaded yet
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/10.jpg not downloaded yet
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:12 [ayvens.de] INFO: Found listing with ID: 1980166
2026-03-24 21:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980166%27 HTTP/1.1" 200 None
2026-03-24 21:46:13 [ayvens.de] INFO: Scrape type for 1980166: 1
2026-03-24 21:46:13 [ayvens.de] INFO: Extracting data for car ID: 1980166
2026-03-24 21:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcb3a863-1393-5f44-bc3b-27a6bfe864db with identifier: 1980166
2026-03-24 21:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb3a863-1393-5f44-bc3b-27a6bfe864db with scrape type 1
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/1.jpg not downloaded yet
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/2.jpg not downloaded yet
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc96f7e50>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/6.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c23710>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/5.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dc8350>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/1.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/3.jpg not downloaded yet
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/4.jpg not downloaded yet
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e14e50>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/3.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5290>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/2.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a90050>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/6.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c15250>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/5.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a93090>
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252Ff19d92a241cb43cd861c3b0d046ec470%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/4.jpg saved to cache
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9548c26e-8216-513f-afbd-b85961919525
2026-03-24 21:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9548c26e-8216-513f-afbd-b85961919525, skipping ID generation
2026-03-24 21:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9548c26e-8216-513f-afbd-b85961919525 with scrape type 1
2026-03-24 21:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9548c26e-8216-513f-afbd-b85961919525 sending to next pipeline
2026-03-24 21:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 9548c26e-8216-513f-afbd-b85961919525, identifier: 1980163
2026-03-24 21:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 9548c26e-8216-513f-afbd-b85961919525 with identifier: 1980163
2026-03-24 21:46:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 9548c26e-8216-513f-afbd-b85961919525 with identifier: 1980163
2026-03-24 21:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 9548c26e-8216-513f-afbd-b85961919525 with identifier: 1980163 to the API
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9548c26e-8216-513f-afbd-b85961919525',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Niro',
 'odometer': 58990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9548c26e-8216-513f-afbd-b85961919525/9548c26e-8216-513f-afbd-b85961919525_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/f19d92a241cb43cd861c3b0d046ec470/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro KIA Niro 1.6 GDI HEV 2WD OPF Aut. Spirit Geschlossen, '
          '5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Niro 1.6 GDI HEV 2WD OPF Aut. Spirit Geschlossen, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980163%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [ayvens.de] INFO: Saving data for 1980163: {'created_time': 1774388774.830195, 'last_price_update_time': 1774388774.830204, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980163') HTTP/1.1" 204 0
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/5.jpg not downloaded yet
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/6.jpg not downloaded yet
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/7.jpg not downloaded yet
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/8.jpg not downloaded yet
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/9.jpg not downloaded yet
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/10.jpg not downloaded yet
2026-03-24 21:46:14 [ayvens.de] INFO: Found listing with ID: 1980167
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980167%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [ayvens.de] INFO: Scrape type for 1980167: 1
2026-03-24 21:46:14 [ayvens.de] INFO: Extracting data for car ID: 1980167
2026-03-24 21:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a686785d-d8cf-5939-85d1-86b28d7dc64f with identifier: 1980167
2026-03-24 21:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a686785d-d8cf-5939-85d1-86b28d7dc64f with scrape type 1
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/1.jpg not downloaded yet
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/2.jpg not downloaded yet
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10d50>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/8.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10f10>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/4.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b54050>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/3.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/3.jpg not downloaded yet
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bccc50>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/7.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd0e10>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/5.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/4.jpg not downloaded yet
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/5.jpg not downloaded yet
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a04b50>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/4.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e15f90>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/10.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd8a50>
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/2.jpg saved to cache
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/6.jpg not downloaded yet
2026-03-24 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/7.jpg not downloaded yet
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/8.jpg not downloaded yet
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/9.jpg not downloaded yet
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/10.jpg not downloaded yet
2026-03-24 21:46:16 [ayvens.de] INFO: Found listing with ID: 1980168
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980168%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [ayvens.de] INFO: Scrape type for 1980168: 1
2026-03-24 21:46:16 [ayvens.de] INFO: Extracting data for car ID: 1980168
2026-03-24 21:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with identifier: 1980168
2026-03-24 21:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with scrape type 1
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/1.jpg not downloaded yet
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cac510>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/1.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/2.jpg not downloaded yet
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bfb010>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/2.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99fe910>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/3.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bbcad0>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/6.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/3.jpg not downloaded yet
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fea5d0>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/10.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c9a350>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/1.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcf050>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/7.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/4.jpg not downloaded yet
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/5.jpg not downloaded yet
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff79d0>
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/8.jpg saved to cache
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/6.jpg not downloaded yet
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/7.jpg not downloaded yet
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/8.jpg not downloaded yet
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/9.jpg not downloaded yet
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/10.jpg not downloaded yet
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dca750>
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohv%252Fb8adb0d7c91e48b3912f61dbe111ce10%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/9.jpg saved to cache
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7864a078-f129-51f5-a393-0a75a5fce65c
2026-03-24 21:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7864a078-f129-51f5-a393-0a75a5fce65c, skipping ID generation
2026-03-24 21:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7864a078-f129-51f5-a393-0a75a5fce65c with scrape type 1
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7864a078-f129-51f5-a393-0a75a5fce65c sending to next pipeline
2026-03-24 21:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7864a078-f129-51f5-a393-0a75a5fce65c, identifier: 1980165
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff6710>
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/5.jpg saved to cache
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:17 [ayvens.de] INFO: Found listing with ID: 1980169
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980169%27 HTTP/1.1" 200 None
2026-03-24 21:46:17 [ayvens.de] INFO: Scrape type for 1980169: 1
2026-03-24 21:46:17 [ayvens.de] INFO: Extracting data for car ID: 1980169
2026-03-24 21:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with identifier: 1980169
2026-03-24 21:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with scrape type 1
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/1.jpg not downloaded yet
2026-03-24 21:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7864a078-f129-51f5-a393-0a75a5fce65c with identifier: 1980165
2026-03-24 21:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7864a078-f129-51f5-a393-0a75a5fce65c with identifier: 1980165
2026-03-24 21:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7864a078-f129-51f5-a393-0a75a5fce65c with identifier: 1980165 to the API
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '7864a078-f129-51f5-a393-0a75a5fce65c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sportage',
 'odometer': 76349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7864a078-f129-51f5-a393-0a75a5fce65c/7864a078-f129-51f5-a393-0a75a5fce65c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohv/b8adb0d7c91e48b3912f61dbe111ce10/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage KIA Sportage 1.6 T-GDI AWD DCT GT LINE Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sportage 1.6 T-GDI AWD DCT GT LINE Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980165%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [ayvens.de] INFO: Saving data for 1980165: {'created_time': 1774388778.038731, 'last_price_update_time': 1774388778.038742, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980165') HTTP/1.1" 204 0
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c98390>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/1.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8f290>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/3.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ffad0>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/2.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c22210>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/4.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd8dd0>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/6.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/2.jpg not downloaded yet
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/3.jpg not downloaded yet
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/4.jpg not downloaded yet
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/5.jpg not downloaded yet
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/6.jpg not downloaded yet
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/7.jpg not downloaded yet
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/8.jpg not downloaded yet
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/9.jpg not downloaded yet
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/10.jpg not downloaded yet
2026-03-24 21:46:18 [ayvens.de] INFO: Found listing with ID: 1980170
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980170%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [ayvens.de] INFO: Scrape type for 1980170: 1
2026-03-24 21:46:18 [ayvens.de] INFO: Extracting data for car ID: 1980170
2026-03-24 21:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with identifier: 1980170
2026-03-24 21:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with scrape type 1
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/1.jpg not downloaded yet
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a05e50>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/10.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/2.jpg not downloaded yet
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a66110>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/2.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1f350>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/4.jpg saved to cache
2026-03-24 21:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c9aa90>
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/10.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a22150>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/1.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a02750>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/6.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1ced0>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/5.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d853d0>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/7.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/3.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/4.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/5.jpg not downloaded yet
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/6.jpg not downloaded yet
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/7.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/8.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/9.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/10.jpg not downloaded yet
2026-03-24 21:46:19 [ayvens.de] INFO: Found listing with ID: 1980171
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980171%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [ayvens.de] INFO: Scrape type for 1980171: 1
2026-03-24 21:46:19 [ayvens.de] INFO: Extracting data for car ID: 1980171
2026-03-24 21:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with identifier: 1980171
2026-03-24 21:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with scrape type 1
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/1.jpg not downloaded yet
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/2.jpg not downloaded yet
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d56550>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/10.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ccf010>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/6.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ef4550>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/1.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eed190>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/8.jpg saved to cache
2026-03-24 21:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d9b850>
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/3.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d64150>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/7.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ef5d10>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/5.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f38f90>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/9.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/3.jpg not downloaded yet
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/4.jpg not downloaded yet
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/5.jpg not downloaded yet
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/6.jpg not downloaded yet
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/7.jpg not downloaded yet
2026-03-24 21:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/8.jpg not downloaded yet
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/9.jpg not downloaded yet
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a03e10>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/3.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/10.jpg not downloaded yet
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d75610>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/2.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a9a190>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/10.jpg saved to cache
2026-03-24 21:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c145d0>
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/2.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce1710>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/9.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d1b10>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/3.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a3a8d0>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/1.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c17310>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/8.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [ayvens.de] INFO: Found listing with ID: 1980172
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980172%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [ayvens.de] INFO: Scrape type for 1980172: 1
2026-03-24 21:46:21 [ayvens.de] INFO: Extracting data for car ID: 1980172
2026-03-24 21:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1980172
2026-03-24 21:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/1.jpg not downloaded yet
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/2.jpg not downloaded yet
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/3.jpg not downloaded yet
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/4.jpg not downloaded yet
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce1150>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/4.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/5.jpg not downloaded yet
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/6.jpg not downloaded yet
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/7.jpg not downloaded yet
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3daadd0>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/7.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3becf10>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/5.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a04d10>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/4.jpg saved to cache
2026-03-24 21:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b28dd0>
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/5.jpg saved to cache
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/8.jpg not downloaded yet
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/9.jpg not downloaded yet
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bed490>
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-h%252F48b62368b21b40628bf681b112725534%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/6.jpg saved to cache
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6
2026-03-24 21:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a02c055d-aac2-5cb6-8182-fe297a4c6fe6, skipping ID generation
2026-03-24 21:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with scrape type 1
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a02c055d-aac2-5cb6-8182-fe297a4c6fe6 sending to next pipeline
2026-03-24 21:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a02c055d-aac2-5cb6-8182-fe297a4c6fe6, identifier: 1980169
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd73ef490>
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/3.jpg saved to cache
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc4550>
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/2.jpg saved to cache
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/10.jpg not downloaded yet
2026-03-24 21:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with identifier: 1980169
2026-03-24 21:46:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with identifier: 1980169
2026-03-24 21:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a02c055d-aac2-5cb6-8182-fe297a4c6fe6 with identifier: 1980169 to the API
2026-03-24 21:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Graphitgrau Metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a02c055d-aac2-5cb6-8182-fe297a4c6fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 106788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02c055d-aac2-5cb6-8182-fe297a4c6fe6/a02c055d-aac2-5cb6-8182-fe297a4c6fe6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-h/48b62368b21b40628bf681b112725534/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 d 4Matic 9G-TRONIC AMG Line '
          'Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 d 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980169%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [ayvens.de] INFO: Saving data for 1980169: {'created_time': 1774388783.51577, 'last_price_update_time': 1774388783.515781, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980169') HTTP/1.1" 204 0
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [ayvens.de] INFO: Found listing with ID: 1980173
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980173%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [ayvens.de] INFO: Scrape type for 1980173: 1
2026-03-24 21:46:23 [ayvens.de] INFO: Extracting data for car ID: 1980173
2026-03-24 21:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f1213c-2818-5edc-98b8-6d8ec345af3a with identifier: 1980173
2026-03-24 21:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f1213c-2818-5edc-98b8-6d8ec345af3a with scrape type 1
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/1.jpg not downloaded yet
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/2.jpg not downloaded yet
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/3.jpg not downloaded yet
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/4.jpg not downloaded yet
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/5.jpg not downloaded yet
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/6.jpg not downloaded yet
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d1bd0>
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/1.jpg saved to cache
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd4e50>
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/10.jpg saved to cache
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/7.jpg not downloaded yet
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/8.jpg not downloaded yet
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/9.jpg not downloaded yet
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8268f90>
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/8.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f3b7d0>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/9.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b416d0>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/7.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d45310>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/1.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d09f10>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/4.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb6450>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/10.jpg saved to cache
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/10.jpg not downloaded yet
2026-03-24 21:46:24 [ayvens.de] INFO: Found listing with ID: 1980174
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980174%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [ayvens.de] INFO: Scrape type for 1980174: 1
2026-03-24 21:46:24 [ayvens.de] INFO: Extracting data for car ID: 1980174
2026-03-24 21:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1980174
2026-03-24 21:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/1.jpg not downloaded yet
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/2.jpg not downloaded yet
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/3.jpg not downloaded yet
2026-03-24 21:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/4.jpg not downloaded yet
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/5.jpg not downloaded yet
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/6.jpg not downloaded yet
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/7.jpg not downloaded yet
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c4ff90>
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/9.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e17a10>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/2.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c31090>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/3.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd8910>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/8.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe3090>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/5.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/8.jpg not downloaded yet
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c06cd0>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/7.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3c310>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/7.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/9.jpg not downloaded yet
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/10.jpg not downloaded yet
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e081d0>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/6.jpg saved to cache
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:25 [ayvens.de] INFO: Found listing with ID: 1980175
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980175%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [ayvens.de] INFO: Scrape type for 1980175: 1
2026-03-24 21:46:25 [ayvens.de] INFO: Extracting data for car ID: 1980175
2026-03-24 21:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with identifier: 1980175
2026-03-24 21:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with scrape type 1
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/1.jpg not downloaded yet
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/2.jpg not downloaded yet
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/3.jpg not downloaded yet
2026-03-24 21:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/4.jpg not downloaded yet
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/5.jpg not downloaded yet
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/6.jpg not downloaded yet
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/7.jpg not downloaded yet
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/8.jpg not downloaded yet
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb42d0>
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/5.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1d010>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/10.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8c150>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/9.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb3ad0>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/4.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/9.jpg not downloaded yet
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8d490>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/2.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd5f155d0>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/1.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ab2210>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/7.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/10.jpg not downloaded yet
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cfa810>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/6.jpg saved to cache
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:26 [ayvens.de] INFO: Found listing with ID: 1980176
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980176%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [ayvens.de] INFO: Scrape type for 1980176: 1
2026-03-24 21:46:26 [ayvens.de] INFO: Extracting data for car ID: 1980176
2026-03-24 21:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099c2e01-1d08-5226-a586-d1e6e51dd030 with identifier: 1980176
2026-03-24 21:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099c2e01-1d08-5226-a586-d1e6e51dd030 with scrape type 1
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/1.jpg not downloaded yet
2026-03-24 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/2.jpg not downloaded yet
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/3.jpg not downloaded yet
2026-03-24 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/4.jpg not downloaded yet
2026-03-24 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cfa750>
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/8.jpg saved to cache
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/5.jpg not downloaded yet
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/6.jpg not downloaded yet
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/7.jpg not downloaded yet
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8215ad0>
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/9.jpg saved to cache
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b65090>
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/10.jpg saved to cache
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/8.jpg not downloaded yet
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99fea50>
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9cb37d408b484217889e07126577760e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/3.jpg saved to cache
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08f1213c-2818-5edc-98b8-6d8ec345af3a
2026-03-24 21:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08f1213c-2818-5edc-98b8-6d8ec345af3a, skipping ID generation
2026-03-24 21:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f1213c-2818-5edc-98b8-6d8ec345af3a with scrape type 1
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08f1213c-2818-5edc-98b8-6d8ec345af3a sending to next pipeline
2026-03-24 21:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 08f1213c-2818-5edc-98b8-6d8ec345af3a, identifier: 1980173
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc3910>
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/8.jpg saved to cache
2026-03-24 21:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 08f1213c-2818-5edc-98b8-6d8ec345af3a with identifier: 1980173
2026-03-24 21:46:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 08f1213c-2818-5edc-98b8-6d8ec345af3a with identifier: 1980173
2026-03-24 21:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 08f1213c-2818-5edc-98b8-6d8ec345af3a with identifier: 1980173 to the API
2026-03-24 21:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '08f1213c-2818-5edc-98b8-6d8ec345af3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Astra',
 'odometer': 136227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f1213c-2818-5edc-98b8-6d8ec345af3a/08f1213c-2818-5edc-98b8-6d8ec345af3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9cb37d408b484217889e07126577760e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL Astra OPEL Astra 1.5 D Start/Stop Sports Tourer Automatik '
          'Elegance Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'OPEL Astra 1.5 D Start/Stop Sports Tourer Automatik Elegance Kombi, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980173%27 HTTP/1.1" 200 None
2026-03-24 21:46:29 [ayvens.de] INFO: Saving data for 1980173: {'created_time': 1774388789.582919, 'last_price_update_time': 1774388789.582929, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980173') HTTP/1.1" 204 0
2026-03-24 21:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/9.jpg not downloaded yet
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ca5ad0>
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/6.jpg saved to cache
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b43650>
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/1.jpg saved to cache
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2b050>
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/7.jpg saved to cache
2026-03-24 21:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/10.jpg not downloaded yet
2026-03-24 21:46:30 [ayvens.de] INFO: Found listing with ID: 1980177
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980177%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [ayvens.de] INFO: Scrape type for 1980177: 1
2026-03-24 21:46:30 [ayvens.de] INFO: Extracting data for car ID: 1980177
2026-03-24 21:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cad24eb-6fab-5360-bd5e-94f2310260ee with identifier: 1980177
2026-03-24 21:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cad24eb-6fab-5360-bd5e-94f2310260ee with scrape type 1
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/1.jpg not downloaded yet
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd6e10>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/1.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/2.jpg not downloaded yet
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/3.jpg not downloaded yet
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/4.jpg not downloaded yet
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/5.jpg not downloaded yet
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/6.jpg not downloaded yet
2026-03-24 21:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/7.jpg not downloaded yet
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc7b90>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/10.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e39e50>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/7.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/8.jpg not downloaded yet
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b54e50>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/9.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb7790>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/8.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38390>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/6.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8fa50>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/9.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/9.jpg not downloaded yet
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/10.jpg not downloaded yet
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23e50>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/5.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c33bd0>
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/10.jpg saved to cache
2026-03-24 21:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:30 [ayvens.de] INFO: Found listing with ID: 1980178
2026-03-24 21:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980178%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [ayvens.de] INFO: Scrape type for 1980178: 1
2026-03-24 21:46:31 [ayvens.de] INFO: Extracting data for car ID: 1980178
2026-03-24 21:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58272ba5-fb70-5efc-9858-587283c32002 with identifier: 1980178
2026-03-24 21:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58272ba5-fb70-5efc-9858-587283c32002 with scrape type 1
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/1.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/2.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/3.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/4.jpg not downloaded yet
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/5.jpg not downloaded yet
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/6.jpg not downloaded yet
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/7.jpg not downloaded yet
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c93a50>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/1.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b66810>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/3.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd2250>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/2.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c88d90>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/5.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/8.jpg not downloaded yet
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce2790>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/6.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a742d0>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/7.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/9.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/10.jpg not downloaded yet
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9717290>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/5.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abd210>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/8.jpg saved to cache
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [ayvens.de] INFO: Found listing with ID: 1980179
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980179%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [ayvens.de] INFO: Scrape type for 1980179: 1
2026-03-24 21:46:31 [ayvens.de] INFO: Extracting data for car ID: 1980179
2026-03-24 21:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25eea541-2574-501b-9ba3-02a08bac5b48 with identifier: 1980179
2026-03-24 21:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eea541-2574-501b-9ba3-02a08bac5b48 with scrape type 1
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/1.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/2.jpg not downloaded yet
2026-03-24 21:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df01d0>
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/10.jpg saved to cache
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/3.jpg not downloaded yet
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/4.jpg not downloaded yet
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/5.jpg not downloaded yet
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cccb90>
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/9.jpg saved to cache
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d85190>
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/4.jpg saved to cache
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b55fd0>
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/1.jpg saved to cache
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf9210>
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcw-%252Fae81509f28b9417bb6801783a0f351bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/4.jpg saved to cache
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 099c2e01-1d08-5226-a586-d1e6e51dd030
2026-03-24 21:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 099c2e01-1d08-5226-a586-d1e6e51dd030, skipping ID generation
2026-03-24 21:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099c2e01-1d08-5226-a586-d1e6e51dd030 with scrape type 1
2026-03-24 21:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 099c2e01-1d08-5226-a586-d1e6e51dd030 sending to next pipeline
2026-03-24 21:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 099c2e01-1d08-5226-a586-d1e6e51dd030, identifier: 1980176
2026-03-24 21:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 099c2e01-1d08-5226-a586-d1e6e51dd030 with identifier: 1980176
2026-03-24 21:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 099c2e01-1d08-5226-a586-d1e6e51dd030 with identifier: 1980176
2026-03-24 21:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 099c2e01-1d08-5226-a586-d1e6e51dd030 with identifier: 1980176 to the API
2026-03-24 21:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '099c2e01-1d08-5226-a586-d1e6e51dd030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 93126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099c2e01-1d08-5226-a586-d1e6e51dd030/099c2e01-1d08-5226-a586-d1e6e51dd030_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cw-/ae81509f28b9417bb6801783a0f351bf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A6 AUDI A6 50 TFSI e quattro S tronic Limousine, 4-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A6 50 TFSI e quattro S tronic Limousine, 4-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980176%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [ayvens.de] INFO: Saving data for 1980176: {'created_time': 1774388793.173576, 'last_price_update_time': 1774388793.173588, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980176') HTTP/1.1" 204 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/6.jpg not downloaded yet
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca4110>
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/3.jpg saved to cache
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c18750>
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/2.jpg saved to cache
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a9a690>
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/8.jpg saved to cache
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/7.jpg not downloaded yet
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/8.jpg not downloaded yet
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/9.jpg not downloaded yet
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/10.jpg not downloaded yet
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [ayvens.de] INFO: Found listing with ID: 1980180
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980180%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [ayvens.de] INFO: Scrape type for 1980180: 1
2026-03-24 21:46:33 [ayvens.de] INFO: Extracting data for car ID: 1980180
2026-03-24 21:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with identifier: 1980180
2026-03-24 21:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with scrape type 1
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/1.jpg not downloaded yet
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/2.jpg not downloaded yet
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc96f73d0>
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/9.jpg saved to cache
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/3.jpg not downloaded yet
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c91650>
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/10.jpg saved to cache
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/4.jpg not downloaded yet
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/5.jpg not downloaded yet
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a57210>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/6.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca5dd0>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/1.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a11890>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/7.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3faead0>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/2.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a11d50>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/8.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d76fd0>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/7.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/6.jpg not downloaded yet
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/7.jpg not downloaded yet
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/8.jpg not downloaded yet
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/9.jpg not downloaded yet
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/10.jpg not downloaded yet
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:34 [ayvens.de] INFO: Found listing with ID: 1980181
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980181%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [ayvens.de] INFO: Scrape type for 1980181: 1
2026-03-24 21:46:34 [ayvens.de] INFO: Extracting data for car ID: 1980181
2026-03-24 21:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea54e43a-a861-50ae-beaf-c4649b45c1e3 with identifier: 1980181
2026-03-24 21:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea54e43a-a861-50ae-beaf-c4649b45c1e3 with scrape type 1
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/1.jpg not downloaded yet
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/2.jpg not downloaded yet
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d76510>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/1.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/3.jpg not downloaded yet
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c14b10>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/6.jpg saved to cache
2026-03-24 21:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d74250>
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/10.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/4.jpg not downloaded yet
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/5.jpg not downloaded yet
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8e190>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/9.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a92e50>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/4.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c76c50>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/6.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd3390>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/5.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3acb690>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/5.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/6.jpg not downloaded yet
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/7.jpg not downloaded yet
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/8.jpg not downloaded yet
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/9.jpg not downloaded yet
2026-03-24 21:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/10.jpg not downloaded yet
2026-03-24 21:46:35 [ayvens.de] INFO: Found listing with ID: 1980182
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980182%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [ayvens.de] INFO: Scrape type for 1980182: 1
2026-03-24 21:46:35 [ayvens.de] INFO: Extracting data for car ID: 1980182
2026-03-24 21:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0902de47-6f5e-519e-ac51-b0abd31d65ab with identifier: 1980182
2026-03-24 21:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0902de47-6f5e-519e-ac51-b0abd31d65ab with scrape type 1
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/1.jpg not downloaded yet
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/2.jpg not downloaded yet
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d089d0>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/7.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/3.jpg not downloaded yet
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce2510>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/3.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a80e90>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/9.jpg saved to cache
2026-03-24 21:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b8e010>
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/4.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd4450>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/8.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/4.jpg not downloaded yet
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/5.jpg not downloaded yet
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2caf990>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/3.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff44d0>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/4.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10d10>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/2.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/6.jpg not downloaded yet
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/7.jpg not downloaded yet
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/8.jpg not downloaded yet
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/9.jpg not downloaded yet
2026-03-24 21:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/10.jpg not downloaded yet
2026-03-24 21:46:36 [ayvens.de] INFO: Found listing with ID: 1980183
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980183%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [ayvens.de] INFO: Scrape type for 1980183: 1
2026-03-24 21:46:36 [ayvens.de] INFO: Extracting data for car ID: 1980183
2026-03-24 21:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with identifier: 1980183
2026-03-24 21:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with scrape type 1
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/1.jpg not downloaded yet
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc60d0>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/8.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/2.jpg not downloaded yet
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a57450>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/2.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dcb1cef10>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/5.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a1b990>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/3.jpg saved to cache
2026-03-24 21:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce9e90>
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/7.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d3a10>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/6.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c70390>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/4.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/3.jpg not downloaded yet
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/4.jpg not downloaded yet
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd0e90>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/2.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/5.jpg not downloaded yet
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/6.jpg not downloaded yet
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/7.jpg not downloaded yet
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/8.jpg not downloaded yet
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/9.jpg not downloaded yet
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/10.jpg not downloaded yet
2026-03-24 21:46:37 [ayvens.de] INFO: Found listing with ID: 1980184
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980184%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [ayvens.de] INFO: Scrape type for 1980184: 1
2026-03-24 21:46:37 [ayvens.de] INFO: Extracting data for car ID: 1980184
2026-03-24 21:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with identifier: 1980184
2026-03-24 21:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with scrape type 1
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/1.jpg not downloaded yet
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ffa50>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/7.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/2.jpg not downloaded yet
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ab3ad0>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/4.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc7d90>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/3.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d458d0>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/6.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2d390>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/5.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb7490>
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/10.jpg saved to cache
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/3.jpg not downloaded yet
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/4.jpg not downloaded yet
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd7050>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/2.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc3050>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/1.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/5.jpg not downloaded yet
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/6.jpg not downloaded yet
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdc550>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/5.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/7.jpg not downloaded yet
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/8.jpg not downloaded yet
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/9.jpg not downloaded yet
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a1a750>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/6.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ceab50>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/1.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7fb10>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/10.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/10.jpg not downloaded yet
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7e690>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/3.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf8090>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/9.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc3c50>
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Frz-%252Fea862be8dfba4c598948dae5c581235a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/8.jpg saved to cache
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea54e43a-a861-50ae-beaf-c4649b45c1e3
2026-03-24 21:46:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea54e43a-a861-50ae-beaf-c4649b45c1e3, skipping ID generation
2026-03-24 21:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea54e43a-a861-50ae-beaf-c4649b45c1e3 with scrape type 1
2026-03-24 21:46:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea54e43a-a861-50ae-beaf-c4649b45c1e3 sending to next pipeline
2026-03-24 21:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ea54e43a-a861-50ae-beaf-c4649b45c1e3, identifier: 1980181
2026-03-24 21:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fd350>
2026-03-24 21:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/9.jpg saved to cache
2026-03-24 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:46:39 [ayvens.de] INFO: Found listing with ID: 1980185
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980185%27 HTTP/1.1" 200 None
2026-03-24 21:46:39 [ayvens.de] INFO: Scrape type for 1980185: 1
2026-03-24 21:46:39 [ayvens.de] INFO: Extracting data for car ID: 1980185
2026-03-24 21:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd125f85-f364-56a2-bbb4-3bdb2252b9dc with identifier: 1980185
2026-03-24 21:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc with scrape type 1
2026-03-24 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/1.jpg not downloaded yet
2026-03-24 21:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ea54e43a-a861-50ae-beaf-c4649b45c1e3 with identifier: 1980181
2026-03-24 21:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ea54e43a-a861-50ae-beaf-c4649b45c1e3 with identifier: 1980181
2026-03-24 21:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ea54e43a-a861-50ae-beaf-c4649b45c1e3 with identifier: 1980181 to the API
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ea54e43a-a861-50ae-beaf-c4649b45c1e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 147489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea54e43a-a861-50ae-beaf-c4649b45c1e3/ea54e43a-a861-50ae-beaf-c4649b45c1e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/rz-/ea862be8dfba4c598948dae5c581235a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, '
          '5-türig, Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV ST-LINE X Geschlossen, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980181%27 HTTP/1.1" 200 None
2026-03-24 21:46:39 [ayvens.de] INFO: Saving data for 1980181: {'created_time': 1774388799.992301, 'last_price_update_time': 1774388799.992314, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980181') HTTP/1.1" 204 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/2.jpg not downloaded yet
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bbcad0>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/4.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/3.jpg not downloaded yet
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/4.jpg not downloaded yet
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/5.jpg not downloaded yet
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/6.jpg not downloaded yet
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/7.jpg not downloaded yet
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/8.jpg not downloaded yet
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/9.jpg not downloaded yet
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc82699d0>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/5.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/10.jpg not downloaded yet
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a90350>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/9.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb1e90>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/1.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bca790>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/2.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d47ed0>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/3.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:40 [ayvens.de] INFO: Found listing with ID: 1980186
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980186%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [ayvens.de] INFO: Scrape type for 1980186: 1
2026-03-24 21:46:40 [ayvens.de] INFO: Extracting data for car ID: 1980186
2026-03-24 21:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a386865-df63-5812-bba1-69e5c3f5561c with identifier: 1980186
2026-03-24 21:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a386865-df63-5812-bba1-69e5c3f5561c with scrape type 1
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/1.jpg not downloaded yet
2026-03-24 21:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/2.jpg not downloaded yet
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3cd50>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/6.jpg saved to cache
2026-03-24 21:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c16950>
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/10.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ecd50>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/2.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/3.jpg not downloaded yet
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/4.jpg not downloaded yet
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a024d0>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/5.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/5.jpg not downloaded yet
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/6.jpg not downloaded yet
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/7.jpg not downloaded yet
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba3f90>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/4.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c88d10>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/10.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1cb10>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/1.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a836d0>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/7.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a78050>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/8.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a83b50>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/10.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/8.jpg not downloaded yet
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/9.jpg not downloaded yet
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b28950>
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/9.jpg saved to cache
2026-03-24 21:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/10.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [ayvens.de] INFO: Found listing with ID: 1980187
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980187%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [ayvens.de] INFO: Scrape type for 1980187: 1
2026-03-24 21:46:42 [ayvens.de] INFO: Extracting data for car ID: 1980187
2026-03-24 21:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with identifier: 1980187
2026-03-24 21:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with scrape type 1
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/1.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/2.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/3.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/4.jpg not downloaded yet
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b29f10>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/8.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/5.jpg not downloaded yet
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aca590>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/9.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eeca50>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/10.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdd610>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/2.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bddc10>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/1.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/6.jpg not downloaded yet
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/7.jpg not downloaded yet
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c9b8d0>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/1.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99fdd10>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/7.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dca017110>
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/6.jpg saved to cache
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/8.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/9.jpg not downloaded yet
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/10.jpg not downloaded yet
2026-03-24 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [ayvens.de] INFO: Found listing with ID: 1980188
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980188%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [ayvens.de] INFO: Scrape type for 1980188: 1
2026-03-24 21:46:43 [ayvens.de] INFO: Extracting data for car ID: 1980188
2026-03-24 21:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with identifier: 1980188
2026-03-24 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with scrape type 1
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/1.jpg not downloaded yet
2026-03-24 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/2.jpg not downloaded yet
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/3.jpg not downloaded yet
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/4.jpg not downloaded yet
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d65e10>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/2.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce24d0>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/4.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/5.jpg not downloaded yet
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f07690>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/8.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/6.jpg not downloaded yet
2026-03-24 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f04b90>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/9.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4090>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/5.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc8950>
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-m%252Ffac06e7849b64261b18e0789681c8dc9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/3.jpg saved to cache
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc
2026-03-24 21:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd125f85-f364-56a2-bbb4-3bdb2252b9dc, skipping ID generation
2026-03-24 21:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc with scrape type 1
2026-03-24 21:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd125f85-f364-56a2-bbb4-3bdb2252b9dc sending to next pipeline
2026-03-24 21:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cd125f85-f364-56a2-bbb4-3bdb2252b9dc, identifier: 1980185
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9ac5a90>
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/3.jpg saved to cache
2026-03-24 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39310>
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/5.jpg saved to cache
2026-03-24 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/7.jpg not downloaded yet
2026-03-24 21:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cd125f85-f364-56a2-bbb4-3bdb2252b9dc with identifier: 1980185
2026-03-24 21:46:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cd125f85-f364-56a2-bbb4-3bdb2252b9dc with identifier: 1980185
2026-03-24 21:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cd125f85-f364-56a2-bbb4-3bdb2252b9dc with identifier: 1980185 to the API
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'cd125f85-f364-56a2-bbb4-3bdb2252b9dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 38232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd125f85-f364-56a2-bbb4-3bdb2252b9dc/cd125f85-f364-56a2-bbb4-3bdb2252b9dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-m/fac06e7849b64261b18e0789681c8dc9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Single Motor 69kWh '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Single Motor 69kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980185%27 HTTP/1.1" 200 None
2026-03-24 21:46:44 [ayvens.de] INFO: Saving data for 1980185: {'created_time': 1774388804.874384, 'last_price_update_time': 1774388804.874394, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980185') HTTP/1.1" 204 0
2026-03-24 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/8.jpg not downloaded yet
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bccc50>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/9.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8f150>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/8.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/9.jpg not downloaded yet
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/10.jpg not downloaded yet
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc30d0>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/7.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5f10>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/10.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:45 [ayvens.de] INFO: Found listing with ID: 1980189
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980189%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [ayvens.de] INFO: Scrape type for 1980189: 1
2026-03-24 21:46:45 [ayvens.de] INFO: Extracting data for car ID: 1980189
2026-03-24 21:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0bea9b-71b0-5e28-84cd-e058969e57be with identifier: 1980189
2026-03-24 21:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0bea9b-71b0-5e28-84cd-e058969e57be with scrape type 1
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/1.jpg not downloaded yet
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/2.jpg not downloaded yet
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/3.jpg not downloaded yet
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a112d0>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/6.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a77fd0>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/1.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3befed0>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/6.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1eb10>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/5.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/4.jpg not downloaded yet
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/5.jpg not downloaded yet
2026-03-24 21:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f3b950>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/7.jpg saved to cache
2026-03-24 21:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d67010>
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/4.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/6.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/7.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/8.jpg not downloaded yet
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8217c10>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/8.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/9.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/10.jpg not downloaded yet
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c28150>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/9.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdae90>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/3.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d86e90>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/3.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a82e50>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/4.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:46 [ayvens.de] INFO: Found listing with ID: 1980190
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980190%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [ayvens.de] INFO: Scrape type for 1980190: 1
2026-03-24 21:46:46 [ayvens.de] INFO: Extracting data for car ID: 1980190
2026-03-24 21:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1980190
2026-03-24 21:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/1.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/2.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/3.jpg not downloaded yet
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4f50>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/2.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/4.jpg not downloaded yet
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/5.jpg not downloaded yet
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f39ad0>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/7.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb7ad0>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/6.jpg saved to cache
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/6.jpg not downloaded yet
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/7.jpg not downloaded yet
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/8.jpg not downloaded yet
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a05e10>
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/5.jpg saved to cache
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd5350>
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/8.jpg saved to cache
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d66210>
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/1.jpg saved to cache
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/9.jpg not downloaded yet
2026-03-24 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/10.jpg not downloaded yet
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9da0110>
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/2.jpg saved to cache
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b54a50>
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252F16261e6b464d40549c9a78f74bedd124%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/10.jpg saved to cache
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8
2026-03-24 21:46:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8, skipping ID generation
2026-03-24 21:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with scrape type 1
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 sending to next pipeline
2026-03-24 21:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8, identifier: 1980187
2026-03-24 21:46:47 [ayvens.de] INFO: Found listing with ID: 1980191
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980191%27 HTTP/1.1" 200 None
2026-03-24 21:46:47 [ayvens.de] INFO: Scrape type for 1980191: 1
2026-03-24 21:46:47 [ayvens.de] INFO: Extracting data for car ID: 1980191
2026-03-24 21:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with identifier: 1980191
2026-03-24 21:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with scrape type 1
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/1.jpg not downloaded yet
2026-03-24 21:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with identifier: 1980187
2026-03-24 21:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with identifier: 1980187
2026-03-24 21:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8 with identifier: 1980187 to the API
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 101970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8/bbb6860c-8d30-526f-bbd3-b0dcb1ff11d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/16261e6b464d40549c9a78f74bedd124/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT Kangoo RENAULT Kangoo Rapid Maxi Blue dCi 95 Extra Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Kangoo Rapid Maxi Blue dCi 95 Extra Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980187%27 HTTP/1.1" 200 None
2026-03-24 21:46:47 [ayvens.de] INFO: Saving data for 1980187: {'created_time': 1774388807.959435, 'last_price_update_time': 1774388807.959445, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980187') HTTP/1.1" 204 0
2026-03-24 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/2.jpg not downloaded yet
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/3.jpg not downloaded yet
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e175d0>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/9.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8da50>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/2.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/4.jpg not downloaded yet
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/5.jpg not downloaded yet
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a99c10>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/6.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a754d0>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/4.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc826a610>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/1.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/6.jpg not downloaded yet
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/7.jpg not downloaded yet
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/8.jpg not downloaded yet
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce0210>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/3.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eec890>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/7.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fc5d0>
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/5.jpg saved to cache
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/9.jpg not downloaded yet
2026-03-24 21:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/10.jpg not downloaded yet
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca6050>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/10.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c70850>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/9.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [ayvens.de] INFO: Found listing with ID: 1980192
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980192%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [ayvens.de] INFO: Scrape type for 1980192: 1
2026-03-24 21:46:49 [ayvens.de] INFO: Extracting data for car ID: 1980192
2026-03-24 21:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with identifier: 1980192
2026-03-24 21:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with scrape type 1
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/1.jpg not downloaded yet
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/2.jpg not downloaded yet
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/3.jpg not downloaded yet
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a13110>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/2.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d57190>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/3.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/4.jpg not downloaded yet
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/5.jpg not downloaded yet
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8217750>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/6.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdad10>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/1.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb6890>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/4.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/6.jpg not downloaded yet
2026-03-24 21:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/7.jpg not downloaded yet
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/8.jpg not downloaded yet
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd92d0>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/7.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3900e50>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/8.jpg saved to cache
2026-03-24 21:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a07e90>
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/5.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/9.jpg not downloaded yet
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/10.jpg not downloaded yet
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10bd0>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/10.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2c290>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/1.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:50 [ayvens.de] INFO: Found listing with ID: 1980193
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980193%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [ayvens.de] INFO: Scrape type for 1980193: 1
2026-03-24 21:46:50 [ayvens.de] INFO: Extracting data for car ID: 1980193
2026-03-24 21:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with identifier: 1980193
2026-03-24 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with scrape type 1
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/1.jpg not downloaded yet
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/2.jpg not downloaded yet
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/3.jpg not downloaded yet
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c16c50>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/2.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c21210>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/3.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/4.jpg not downloaded yet
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/5.jpg not downloaded yet
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc60d0>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/4.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba3c50>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fs-e%252Fee474b6ab145454da6069f1675b992da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/9.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39c058b7-1536-5792-97e2-c298dcdfc9fc
2026-03-24 21:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39c058b7-1536-5792-97e2-c298dcdfc9fc, skipping ID generation
2026-03-24 21:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c058b7-1536-5792-97e2-c298dcdfc9fc with scrape type 1
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39c058b7-1536-5792-97e2-c298dcdfc9fc sending to next pipeline
2026-03-24 21:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 39c058b7-1536-5792-97e2-c298dcdfc9fc, identifier: 1980190
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff7b90>
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/6.jpg saved to cache
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/6.jpg not downloaded yet
2026-03-24 21:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1980190
2026-03-24 21:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1980190
2026-03-24 21:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 39c058b7-1536-5792-97e2-c298dcdfc9fc with identifier: 1980190 to the API
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '39c058b7-1536-5792-97e2-c298dcdfc9fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 55520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39c058b7-1536-5792-97e2-c298dcdfc9fc/39c058b7-1536-5792-97e2-c298dcdfc9fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/s-e/ee474b6ab145454da6069f1675b992da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort '
          'Kasten, 3-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 145 L1H1 3,0t Komfort Kasten, 3-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980190%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [ayvens.de] INFO: Saving data for 1980190: {'created_time': 1774388811.335386, 'last_price_update_time': 1774388811.335397, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980190') HTTP/1.1" 204 0
2026-03-24 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/7.jpg not downloaded yet
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/8.jpg not downloaded yet
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dc91d0>
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/5.jpg saved to cache
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d549d0>
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/8.jpg saved to cache
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ca4f90>
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/7.jpg saved to cache
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/9.jpg not downloaded yet
2026-03-24 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/10.jpg not downloaded yet
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d06d0>
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/10.jpg saved to cache
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3febd10>
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fse-%252F07e728a5b3cd409dbfec06bec7fb97ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/9.jpg saved to cache
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca
2026-03-24 21:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca, skipping ID generation
2026-03-24 21:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with scrape type 1
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca sending to next pipeline
2026-03-24 21:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca, identifier: 1980191
2026-03-24 21:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:51 [ayvens.de] INFO: Found listing with ID: 1980194
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980194%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [ayvens.de] INFO: Scrape type for 1980194: 1
2026-03-24 21:46:51 [ayvens.de] INFO: Extracting data for car ID: 1980194
2026-03-24 21:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with identifier: 1980194
2026-03-24 21:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with scrape type 1
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/1.jpg not downloaded yet
2026-03-24 21:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with identifier: 1980191
2026-03-24 21:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with identifier: 1980191
2026-03-24 21:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca with identifier: 1980191 to the API
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 16293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca/fc10e478-8fb3-5dcc-bfee-195fa6e6b2ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/se-/07e728a5b3cd409dbfec06bec7fb97ab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT ZOE (ohne Batterie) Z.E. 50 EXPERIENCE Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980191%27 HTTP/1.1" 200 None
2026-03-24 21:46:52 [ayvens.de] INFO: Saving data for 1980191: {'created_time': 1774388812.296551, 'last_price_update_time': 1774388812.296561, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980191') HTTP/1.1" 204 0
2026-03-24 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/2.jpg not downloaded yet
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/3.jpg not downloaded yet
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a98210>
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/2.jpg saved to cache
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b57c10>
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/3.jpg saved to cache
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe0110>
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F725ceafa6f3849d09574415299727b0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/8.jpg saved to cache
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e0bea9b-71b0-5e28-84cd-e058969e57be
2026-03-24 21:46:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e0bea9b-71b0-5e28-84cd-e058969e57be, skipping ID generation
2026-03-24 21:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0bea9b-71b0-5e28-84cd-e058969e57be with scrape type 1
2026-03-24 21:46:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e0bea9b-71b0-5e28-84cd-e058969e57be sending to next pipeline
2026-03-24 21:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 9e0bea9b-71b0-5e28-84cd-e058969e57be, identifier: 1980189
2026-03-24 21:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 9e0bea9b-71b0-5e28-84cd-e058969e57be with identifier: 1980189
2026-03-24 21:46:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 9e0bea9b-71b0-5e28-84cd-e058969e57be with identifier: 1980189
2026-03-24 21:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 9e0bea9b-71b0-5e28-84cd-e058969e57be with identifier: 1980189 to the API
2026-03-24 21:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '9e0bea9b-71b0-5e28-84cd-e058969e57be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 55416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0bea9b-71b0-5e28-84cd-e058969e57be/9e0bea9b-71b0-5e28-84cd-e058969e57be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/725ceafa6f3849d09574415299727b0a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour BLUE dCi 115 BUSINESS '
          'EDITION Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour BLUE dCi 115 BUSINESS EDITION Kombi, '
         '5-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980189%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [ayvens.de] INFO: Saving data for 1980189: {'created_time': 1774388813.139548, 'last_price_update_time': 1774388813.139561, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980189') HTTP/1.1" 204 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/4.jpg not downloaded yet
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/5.jpg not downloaded yet
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca4650>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/5.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8e8d0>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/6.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dd8150>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/4.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/6.jpg not downloaded yet
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/7.jpg not downloaded yet
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d460d0>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/7.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dcba10>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/8.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/8.jpg not downloaded yet
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/9.jpg not downloaded yet
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce2c50>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/10.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ca77d0>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/1.jpg saved to cache
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/10.jpg not downloaded yet
2026-03-24 21:46:53 [ayvens.de] INFO: Found listing with ID: 1980195
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980195%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [ayvens.de] INFO: Scrape type for 1980195: 1
2026-03-24 21:46:53 [ayvens.de] INFO: Extracting data for car ID: 1980195
2026-03-24 21:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with identifier: 1980195
2026-03-24 21:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with scrape type 1
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/1.jpg not downloaded yet
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/2.jpg not downloaded yet
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f39410>
2026-03-24 21:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/3.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f64d0>
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/2.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/3.jpg not downloaded yet
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/4.jpg not downloaded yet
2026-03-24 21:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce1650>
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/9.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d53e90>
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252Fbb584d38cb914e538568a513e4e1c5ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/1.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7
2026-03-24 21:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8452d284-2d9d-5b14-9899-5ad7dace1ad7, skipping ID generation
2026-03-24 21:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with scrape type 1
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8452d284-2d9d-5b14-9899-5ad7dace1ad7 sending to next pipeline
2026-03-24 21:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8452d284-2d9d-5b14-9899-5ad7dace1ad7, identifier: 1980192
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff58d0>
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/5.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c76210>
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/6.jpg saved to cache
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/5.jpg not downloaded yet
2026-03-24 21:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with identifier: 1980192
2026-03-24 21:46:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with identifier: 1980192
2026-03-24 21:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8452d284-2d9d-5b14-9899-5ad7dace1ad7 with identifier: 1980192 to the API
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '8452d284-2d9d-5b14-9899-5ad7dace1ad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 154521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8452d284-2d9d-5b14-9899-5ad7dace1ad7/8452d284-2d9d-5b14-9899-5ad7dace1ad7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/bb584d38cb914e538568a513e4e1c5ac/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia SKODA Octavia Combi 1.5 TSI e-TEC DSG Style Kombi, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'SKODA Octavia Combi 1.5 TSI e-TEC DSG Style Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980192%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [ayvens.de] INFO: Saving data for 1980192: {'created_time': 1774388815.038827, 'last_price_update_time': 1774388815.038837, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980192') HTTP/1.1" 204 0
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/6.jpg not downloaded yet
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/7.jpg not downloaded yet
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c23250>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/8.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/8.jpg not downloaded yet
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/9.jpg not downloaded yet
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bed790>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/9.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2a990>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/2.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd1ed0>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/10.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/10.jpg not downloaded yet
2026-03-24 21:46:55 [ayvens.de] INFO: Found listing with ID: 1980196
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980196%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [ayvens.de] INFO: Scrape type for 1980196: 1
2026-03-24 21:46:55 [ayvens.de] INFO: Extracting data for car ID: 1980196
2026-03-24 21:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3450acba-a701-510a-844d-3f2901a37a0e with identifier: 1980196
2026-03-24 21:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3450acba-a701-510a-844d-3f2901a37a0e with scrape type 1
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/1.jpg not downloaded yet
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/2.jpg not downloaded yet
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fe5d0>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/7.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d46490>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/1.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a11390>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/3.jpg saved to cache
2026-03-24 21:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd9b90>
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252Fb6234a40688e4500af87e96fc6ae3a9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/4.jpg saved to cache
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7
2026-03-24 21:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ff8b00d-e850-5389-bec5-eae04bfe66a7, skipping ID generation
2026-03-24 21:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with scrape type 1
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ff8b00d-e850-5389-bec5-eae04bfe66a7 sending to next pipeline
2026-03-24 21:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8ff8b00d-e850-5389-bec5-eae04bfe66a7, identifier: 1980193
2026-03-24 21:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with identifier: 1980193
2026-03-24 21:46:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with identifier: 1980193
2026-03-24 21:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8ff8b00d-e850-5389-bec5-eae04bfe66a7 with identifier: 1980193 to the API
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '8ff8b00d-e850-5389-bec5-eae04bfe66a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 112730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ff8b00d-e850-5389-bec5-eae04bfe66a7/8ff8b00d-e850-5389-bec5-eae04bfe66a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/b6234a40688e4500af87e96fc6ae3a9f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980193%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [ayvens.de] INFO: Saving data for 1980193: {'created_time': 1774388816.481389, 'last_price_update_time': 1774388816.4814, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980193') HTTP/1.1" 204 0
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/3.jpg not downloaded yet
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/4.jpg not downloaded yet
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/5.jpg not downloaded yet
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/6.jpg not downloaded yet
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/7.jpg not downloaded yet
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd25d0>
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/5.jpg saved to cache
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/8.jpg not downloaded yet
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/9.jpg not downloaded yet
2026-03-24 21:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/10.jpg not downloaded yet
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a18610>
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/7.jpg saved to cache
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c06d90>
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/9.jpg saved to cache
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce9f90>
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/4.jpg saved to cache
2026-03-24 21:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7c250>
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/8.jpg saved to cache
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10790>
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/10.jpg saved to cache
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:57 [ayvens.de] INFO: Found listing with ID: 1980197
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980197%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [ayvens.de] INFO: Scrape type for 1980197: 1
2026-03-24 21:46:57 [ayvens.de] INFO: Extracting data for car ID: 1980197
2026-03-24 21:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with identifier: 1980197
2026-03-24 21:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with scrape type 1
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/1.jpg not downloaded yet
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/2.jpg not downloaded yet
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca65d0>
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F29d2cf86965f42ccad332d1e7f0c0035%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/6.jpg saved to cache
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e
2026-03-24 21:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e, skipping ID generation
2026-03-24 21:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with scrape type 1
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe411caa-a629-58e2-bfc2-6f1a7a1fb42e sending to next pipeline
2026-03-24 21:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e, identifier: 1980194
2026-03-24 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/3.jpg not downloaded yet
2026-03-24 21:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with identifier: 1980194
2026-03-24 21:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with identifier: 1980194
2026-03-24 21:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fe411caa-a629-58e2-bfc2-6f1a7a1fb42e with identifier: 1980194 to the API
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'fe411caa-a629-58e2-bfc2-6f1a7a1fb42e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 6982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe411caa-a629-58e2-bfc2-6f1a7a1fb42e/fe411caa-a629-58e2-bfc2-6f1a7a1fb42e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/29d2cf86965f42ccad332d1e7f0c0035/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 Langstreckenbatt. Allradantrieb Dual '
          'Motor Limousine, 4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 Langstreckenbatt. Allradantrieb Dual Motor Limousine, '
         '4-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980194%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [ayvens.de] INFO: Saving data for 1980194: {'created_time': 1774388817.872225, 'last_price_update_time': 1774388817.872235, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980194') HTTP/1.1" 204 0
2026-03-24 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/4.jpg not downloaded yet
2026-03-24 21:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcafd0>
2026-03-24 21:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/3.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c8a950>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/4.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8216790>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/7.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/5.jpg not downloaded yet
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/6.jpg not downloaded yet
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d2710>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/6.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d47090>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/5.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/7.jpg not downloaded yet
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/8.jpg not downloaded yet
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a90b50>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/2.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/9.jpg not downloaded yet
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/10.jpg not downloaded yet
2026-03-24 21:46:58 [ayvens.de] INFO: Found listing with ID: 1980198
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980198%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [ayvens.de] INFO: Scrape type for 1980198: 1
2026-03-24 21:46:58 [ayvens.de] INFO: Extracting data for car ID: 1980198
2026-03-24 21:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with identifier: 1980198
2026-03-24 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with scrape type 1
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/1.jpg not downloaded yet
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe1e10>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/1.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e15450>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/8.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/2.jpg not downloaded yet
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/3.jpg not downloaded yet
2026-03-24 21:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c17010>
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhf-%252F33c464e698294b109e2e6b8180f4fdc3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/10.jpg saved to cache
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d
2026-03-24 21:46:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d, skipping ID generation
2026-03-24 21:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with scrape type 1
2026-03-24 21:46:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d sending to next pipeline
2026-03-24 21:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d, identifier: 1980188
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb50d0>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/2.jpg saved to cache
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c98950>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/4.jpg saved to cache
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d1a10>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/3.jpg saved to cache
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/4.jpg not downloaded yet
2026-03-24 21:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with identifier: 1980188
2026-03-24 21:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with identifier: 1980188
2026-03-24 21:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d with identifier: 1980188 to the API
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 46968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d/17e18cf3-6d8a-5c85-8dc1-71c8b5098a4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hf-/33c464e698294b109e2e6b8180f4fdc3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master dCi 135 L2H1 VA Pritsche, '
          '2-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master dCi 135 L2H1 VA Pritsche, 2-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980188%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [ayvens.de] INFO: Saving data for 1980188: {'created_time': 1774388819.707801, 'last_price_update_time': 1774388819.707812, 'auction_closing_time': 1774447200.0}
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980188') HTTP/1.1" 204 0
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/5.jpg not downloaded yet
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/6.jpg not downloaded yet
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bed610>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/1.jpg saved to cache
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1a050>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/10.jpg saved to cache
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/7.jpg not downloaded yet
2026-03-24 21:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/8.jpg not downloaded yet
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f3aed0>
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/9.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce31d0>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/6.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/9.jpg not downloaded yet
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/10.jpg not downloaded yet
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [ayvens.de] INFO: Found listing with ID: 1980199
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980199%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [ayvens.de] INFO: Scrape type for 1980199: 1
2026-03-24 21:47:00 [ayvens.de] INFO: Extracting data for car ID: 1980199
2026-03-24 21:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a311814c-cf1c-5a50-ac46-a561ae042e69 with identifier: 1980199
2026-03-24 21:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a311814c-cf1c-5a50-ac46-a561ae042e69 with scrape type 1
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/1.jpg not downloaded yet
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc4110>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/1.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe3550>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/2.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a0efd0>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/8.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d53190>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/10.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/2.jpg not downloaded yet
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/3.jpg not downloaded yet
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc392bcd0>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/3.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba3790>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/5.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/4.jpg not downloaded yet
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/5.jpg not downloaded yet
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/6.jpg not downloaded yet
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1bf50>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/6.jpg saved to cache
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/7.jpg not downloaded yet
2026-03-24 21:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/8.jpg not downloaded yet
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a03d10>
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/4.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df2510>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/8.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d65950>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/9.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd2410>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/7.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/9.jpg not downloaded yet
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/10.jpg not downloaded yet
2026-03-24 21:47:01 [ayvens.de] INFO: Found listing with ID: 1980200
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980200%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [ayvens.de] INFO: Scrape type for 1980200: 1
2026-03-24 21:47:01 [ayvens.de] INFO: Extracting data for car ID: 1980200
2026-03-24 21:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca13e599-8370-55c5-ba26-25c91271691a with identifier: 1980200
2026-03-24 21:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca13e599-8370-55c5-ba26-25c91271691a with scrape type 1
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/1.jpg not downloaded yet
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d66bd0>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/7.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdfd90>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/1.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/2.jpg not downloaded yet
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/3.jpg not downloaded yet
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba1c90>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/2.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd1ad0>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/4.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/4.jpg not downloaded yet
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/5.jpg not downloaded yet
2026-03-24 21:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/6.jpg not downloaded yet
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f07f50>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/6.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a90a90>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/3.jpg saved to cache
2026-03-24 21:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dca1d0>
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252F4401116990cf4d20aa63200a9f17c6bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/10.jpg saved to cache
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363
2026-03-24 21:47:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363, skipping ID generation
2026-03-24 21:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with scrape type 1
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 sending to next pipeline
2026-03-24 21:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363, identifier: 1980197
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd3b50>
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/5.jpg saved to cache
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with identifier: 1980197
2026-03-24 21:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with identifier: 1980197
2026-03-24 21:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6a8abb56-a6e6-5c75-8ee6-2635cbbda363 with identifier: 1980197 to the API
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6a8abb56-a6e6-5c75-8ee6-2635cbbda363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 114317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a8abb56-a6e6-5c75-8ee6-2635cbbda363/6a8abb56-a6e6-5c75-8ee6-2635cbbda363_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/4401116990cf4d20aa63200a9f17c6bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat VW Passat Variant 1.4 TSI Plug-In-Hybrid DSG GTE '
          'Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Passat Variant 1.4 TSI Plug-In-Hybrid DSG GTE Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980197%27 HTTP/1.1" 200 None
2026-03-24 21:47:02 [ayvens.de] INFO: Saving data for 1980197: {'created_time': 1774388822.757244, 'last_price_update_time': 1774388822.757254, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980197') HTTP/1.1" 204 0
2026-03-24 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/7.jpg not downloaded yet
2026-03-24 21:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/8.jpg not downloaded yet
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a41a90>
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/9.jpg saved to cache
2026-03-24 21:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe0f10>
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/7.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/9.jpg not downloaded yet
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/10.jpg not downloaded yet
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a64050>
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/1.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c629d0>
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/10.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [ayvens.de] INFO: Found listing with ID: 1980201
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980201%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [ayvens.de] INFO: Scrape type for 1980201: 1
2026-03-24 21:47:03 [ayvens.de] INFO: Extracting data for car ID: 1980201
2026-03-24 21:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with identifier: 1980201
2026-03-24 21:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with scrape type 1
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/1.jpg not downloaded yet
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/2.jpg not downloaded yet
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc971acd0>
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/2.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcac50>
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/3.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c20950>
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fnk-%252F7ad80749516c4d1cb3a9aed804b107b0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/8.jpg saved to cache
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8
2026-03-24 21:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8, skipping ID generation
2026-03-24 21:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with scrape type 1
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 sending to next pipeline
2026-03-24 21:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8, identifier: 1980198
2026-03-24 21:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/3.jpg not downloaded yet
2026-03-24 21:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with identifier: 1980198
2026-03-24 21:47:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with identifier: 1980198
2026-03-24 21:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3b43e0b6-8fa0-5c25-8c1e-5706b670daa8 with identifier: 1980198 to the API
2026-03-24 21:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'Phantom Black Metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3b43e0b6-8fa0-5c25-8c1e-5706b670daa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 94985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b43e0b6-8fa0-5c25-8c1e-5706b670daa8/3b43e0b6-8fa0-5c25-8c1e-5706b670daa8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/nk-/7ad80749516c4d1cb3a9aed804b107b0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE HYUNDAI SANTA FE 1.6 Plugin-Hybrid 4WD Prime '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI SANTA FE 1.6 Plugin-Hybrid 4WD Prime Geschlossen, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980198%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [ayvens.de] INFO: Saving data for 1980198: {'created_time': 1774388824.166323, 'last_price_update_time': 1774388824.166335, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980198') HTTP/1.1" 204 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/4.jpg not downloaded yet
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/5.jpg not downloaded yet
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe2d10>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/4.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba1950>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/5.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb6710>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/6.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/6.jpg not downloaded yet
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d85510>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/9.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/7.jpg not downloaded yet
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/8.jpg not downloaded yet
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d84750>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/8.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/9.jpg not downloaded yet
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/10.jpg not downloaded yet
2026-03-24 21:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb5950>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/1.jpg saved to cache
2026-03-24 21:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9717d90>
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/10.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:05 [ayvens.de] INFO: Found listing with ID: 1980202
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980202%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [ayvens.de] INFO: Scrape type for 1980202: 1
2026-03-24 21:47:05 [ayvens.de] INFO: Extracting data for car ID: 1980202
2026-03-24 21:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1980202
2026-03-24 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 with scrape type 1
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/1.jpg not downloaded yet
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/2.jpg not downloaded yet
2026-03-24 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/3.jpg not downloaded yet
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c218d0>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fog-%252F20b2fbb43fb9408baccc938b55c13ca2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/7.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a311814c-cf1c-5a50-ac46-a561ae042e69
2026-03-24 21:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a311814c-cf1c-5a50-ac46-a561ae042e69, skipping ID generation
2026-03-24 21:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a311814c-cf1c-5a50-ac46-a561ae042e69 with scrape type 1
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a311814c-cf1c-5a50-ac46-a561ae042e69 sending to next pipeline
2026-03-24 21:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a311814c-cf1c-5a50-ac46-a561ae042e69, identifier: 1980199
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4e90>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/2.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1c9d0>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/4.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8ded0>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/5.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a311814c-cf1c-5a50-ac46-a561ae042e69 with identifier: 1980199
2026-03-24 21:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a311814c-cf1c-5a50-ac46-a561ae042e69 with identifier: 1980199
2026-03-24 21:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a311814c-cf1c-5a50-ac46-a561ae042e69 with identifier: 1980199 to the API
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a311814c-cf1c-5a50-ac46-a561ae042e69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 101419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a311814c-cf1c-5a50-ac46-a561ae042e69/a311814c-cf1c-5a50-ac46-a561ae042e69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/og-/20b2fbb43fb9408baccc938b55c13ca2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Platinum '
          'Edition Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Platinum Edition '
         'Geschlossen, 5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980199%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [ayvens.de] INFO: Saving data for 1980199: {'created_time': 1774388825.804936, 'last_price_update_time': 1774388825.804946, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980199') HTTP/1.1" 204 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/4.jpg not downloaded yet
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/5.jpg not downloaded yet
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a41950>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/6.jpg saved to cache
2026-03-24 21:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8216110>
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/7.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/6.jpg not downloaded yet
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/7.jpg not downloaded yet
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/8.jpg not downloaded yet
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/9.jpg not downloaded yet
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/10.jpg not downloaded yet
2026-03-24 21:47:06 [ayvens.de] INFO: Found listing with ID: 1980203
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980203%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [ayvens.de] INFO: Scrape type for 1980203: 1
2026-03-24 21:47:06 [ayvens.de] INFO: Extracting data for car ID: 1980203
2026-03-24 21:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with identifier: 1980203
2026-03-24 21:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with scrape type 1
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/1.jpg not downloaded yet
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/2.jpg not downloaded yet
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc3e10>
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/8.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39650>
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/9.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d57650>
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/3.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bda750>
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/1.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/3.jpg not downloaded yet
2026-03-24 21:47:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 0 pages/min), scraped 38 items (at 20 items/min)
2026-03-24 21:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe90d0>
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F49c8ce208edd4064ae58666aaed215ff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/10.jpg saved to cache
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca13e599-8370-55c5-ba26-25c91271691a
2026-03-24 21:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca13e599-8370-55c5-ba26-25c91271691a, skipping ID generation
2026-03-24 21:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca13e599-8370-55c5-ba26-25c91271691a with scrape type 1
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca13e599-8370-55c5-ba26-25c91271691a sending to next pipeline
2026-03-24 21:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ca13e599-8370-55c5-ba26-25c91271691a, identifier: 1980200
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/4.jpg not downloaded yet
2026-03-24 21:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ca13e599-8370-55c5-ba26-25c91271691a with identifier: 1980200
2026-03-24 21:47:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ca13e599-8370-55c5-ba26-25c91271691a with identifier: 1980200
2026-03-24 21:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ca13e599-8370-55c5-ba26-25c91271691a with identifier: 1980200 to the API
2026-03-24 21:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ca13e599-8370-55c5-ba26-25c91271691a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 65786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca13e599-8370-55c5-ba26-25c91271691a/ca13e599-8370-55c5-ba26-25c91271691a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/49c8ce208edd4064ae58666aaed215ff/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse MERCEDES-BENZ A 250 e 8G-DCT Advanced '
          'Progressive Limousine, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ A 250 e 8G-DCT Advanced Progressive Limousine, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980200%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [ayvens.de] INFO: Saving data for 1980200: {'created_time': 1774388827.1326, 'last_price_update_time': 1774388827.132611, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980200') HTTP/1.1" 204 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/5.jpg not downloaded yet
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba1510>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/2.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c755d0>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/4.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c73d50>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/3.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/6.jpg not downloaded yet
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/7.jpg not downloaded yet
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/8.jpg not downloaded yet
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/9.jpg not downloaded yet
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/10.jpg not downloaded yet
2026-03-24 21:47:07 [ayvens.de] INFO: Found listing with ID: 1980204
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980204%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [ayvens.de] INFO: Scrape type for 1980204: 1
2026-03-24 21:47:07 [ayvens.de] INFO: Extracting data for car ID: 1980204
2026-03-24 21:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159e2404-facb-5ec5-829c-072720f72578 with identifier: 1980204
2026-03-24 21:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159e2404-facb-5ec5-829c-072720f72578 with scrape type 1
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/1.jpg not downloaded yet
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/2.jpg not downloaded yet
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc970d590>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/1.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc826ba50>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/2.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/3.jpg not downloaded yet
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/4.jpg not downloaded yet
2026-03-24 21:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/5.jpg not downloaded yet
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c232d0>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/7.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2ad0>
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/6.jpg saved to cache
2026-03-24 21:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ac9650>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/8.jpg saved to cache
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2b50>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252Fbc1143f872264efb8763b98b44b1c2b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/5.jpg saved to cache
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3450acba-a701-510a-844d-3f2901a37a0e
2026-03-24 21:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3450acba-a701-510a-844d-3f2901a37a0e, skipping ID generation
2026-03-24 21:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3450acba-a701-510a-844d-3f2901a37a0e with scrape type 1
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3450acba-a701-510a-844d-3f2901a37a0e sending to next pipeline
2026-03-24 21:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3450acba-a701-510a-844d-3f2901a37a0e, identifier: 1980196
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9ac4850>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/9.jpg saved to cache
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c74d50>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/5.jpg saved to cache
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3450acba-a701-510a-844d-3f2901a37a0e with identifier: 1980196
2026-03-24 21:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3450acba-a701-510a-844d-3f2901a37a0e with identifier: 1980196
2026-03-24 21:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3450acba-a701-510a-844d-3f2901a37a0e with identifier: 1980196 to the API
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '3450acba-a701-510a-844d-3f2901a37a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf VIII',
 'odometer': 105683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3450acba-a701-510a-844d-3f2901a37a0e/3450acba-a701-510a-844d-3f2901a37a0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/bc1143f872264efb8763b98b44b1c2b4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf VIII VW Golf Variant 2.0 TDI SCR Kombi, 5-türig, '
          '6-Gang',
 'transmission': 'manual',
 'trim': 'VW Golf Variant 2.0 TDI SCR Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980196%27 HTTP/1.1" 200 None
2026-03-24 21:47:08 [ayvens.de] INFO: Saving data for 1980196: {'created_time': 1774388828.769923, 'last_price_update_time': 1774388828.769932, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980196') HTTP/1.1" 204 0
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/6.jpg not downloaded yet
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/7.jpg not downloaded yet
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38910>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/4.jpg saved to cache
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/8.jpg not downloaded yet
2026-03-24 21:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/9.jpg not downloaded yet
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c8a750>
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/5.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff5190>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/3.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/10.jpg not downloaded yet
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dca016f10>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/7.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a78510>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/1.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d86b50>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/3.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:09 [ayvens.de] INFO: Found listing with ID: 1980205
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980205%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [ayvens.de] INFO: Scrape type for 1980205: 1
2026-03-24 21:47:09 [ayvens.de] INFO: Extracting data for car ID: 1980205
2026-03-24 21:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with identifier: 1980205
2026-03-24 21:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with scrape type 1
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/1.jpg not downloaded yet
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9717410>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/6.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e15c90>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/2.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/2.jpg not downloaded yet
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/3.jpg not downloaded yet
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/4.jpg not downloaded yet
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/5.jpg not downloaded yet
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/6.jpg not downloaded yet
2026-03-24 21:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/7.jpg not downloaded yet
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/8.jpg not downloaded yet
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c23810>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/5.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/9.jpg not downloaded yet
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d85f90>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/6.jpg saved to cache
2026-03-24 21:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f4e10>
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/7.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/10.jpg not downloaded yet
2026-03-24 21:47:10 [ayvens.de] INFO: Found listing with ID: 1980206
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980206%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [ayvens.de] INFO: Scrape type for 1980206: 1
2026-03-24 21:47:10 [ayvens.de] INFO: Extracting data for car ID: 1980206
2026-03-24 21:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2161a3-385c-582f-96c7-931fe26b726a with identifier: 1980206
2026-03-24 21:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2161a3-385c-582f-96c7-931fe26b726a with scrape type 1
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/1.jpg not downloaded yet
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c8b2d0>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/10.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd1d90>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/1.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d67250>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/3.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd0690>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/2.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c88450>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/9.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/2.jpg not downloaded yet
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/3.jpg not downloaded yet
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/4.jpg not downloaded yet
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/5.jpg not downloaded yet
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/6.jpg not downloaded yet
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/7.jpg not downloaded yet
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe1cd0>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/5.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/8.jpg not downloaded yet
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a41a90>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/6.jpg saved to cache
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/9.jpg not downloaded yet
2026-03-24 21:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/10.jpg not downloaded yet
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc96f7e10>
2026-03-24 21:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/8.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c63b10>
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F18dcfe18e05c4b3faeff83da1bb1a052%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/4.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78
2026-03-24 21:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57ee5c71-ee92-5f4d-88b0-832ee430bd78, skipping ID generation
2026-03-24 21:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with scrape type 1
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57ee5c71-ee92-5f4d-88b0-832ee430bd78 sending to next pipeline
2026-03-24 21:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 57ee5c71-ee92-5f4d-88b0-832ee430bd78, identifier: 1980203
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df2690>
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/4.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a80690>
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/10.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3cc90>
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/7.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e14cd0>
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/8.jpg saved to cache
2026-03-24 21:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with identifier: 1980203
2026-03-24 21:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with identifier: 1980203
2026-03-24 21:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 57ee5c71-ee92-5f4d-88b0-832ee430bd78 with identifier: 1980203 to the API
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '57ee5c71-ee92-5f4d-88b0-832ee430bd78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 179482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57ee5c71-ee92-5f4d-88b0-832ee430bd78/57ee5c71-ee92-5f4d-88b0-832ee430bd78_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/18dcfe18e05c4b3faeff83da1bb1a052/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980203%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [ayvens.de] INFO: Saving data for 1980203: {'created_time': 1774388832.011731, 'last_price_update_time': 1774388832.011741, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980203') HTTP/1.1" 204 0
2026-03-24 21:47:12 [ayvens.de] INFO: Found listing with ID: 1980207
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980207%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [ayvens.de] INFO: Scrape type for 1980207: 1
2026-03-24 21:47:12 [ayvens.de] INFO: Extracting data for car ID: 1980207
2026-03-24 21:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a6766ba-e511-57fe-8dc9-94f351bc1538 with identifier: 1980207
2026-03-24 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6766ba-e511-57fe-8dc9-94f351bc1538 with scrape type 1
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/1.jpg not downloaded yet
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/2.jpg not downloaded yet
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3917f10>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/3.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c71e10>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/2.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/3.jpg not downloaded yet
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/4.jpg not downloaded yet
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd79d0>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/10.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe8bd0>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/10.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d67210>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/1.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/5.jpg not downloaded yet
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/6.jpg not downloaded yet
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cfa450>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/8.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dda190>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/9.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce1310>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/7.jpg saved to cache
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/7.jpg not downloaded yet
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/8.jpg not downloaded yet
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/9.jpg not downloaded yet
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/10.jpg not downloaded yet
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:12 [ayvens.de] INFO: Found listing with ID: 1980208
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980208%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [ayvens.de] INFO: Scrape type for 1980208: 1
2026-03-24 21:47:12 [ayvens.de] INFO: Extracting data for car ID: 1980208
2026-03-24 21:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b025db-2342-5526-8e82-ae07c6c129d5 with identifier: 1980208
2026-03-24 21:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b025db-2342-5526-8e82-ae07c6c129d5 with scrape type 1
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/1.jpg not downloaded yet
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/2.jpg not downloaded yet
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c91650>
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/2.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/3.jpg not downloaded yet
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/4.jpg not downloaded yet
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/5.jpg not downloaded yet
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df3850>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/1.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bce650>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/4.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb4090>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/10.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba0210>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/3.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c14fd0>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/5.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe3150>
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Flb-%252F6c1751a6b61b4ad6a8db9dc4b87a91e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/6.jpg saved to cache
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a
2026-03-24 21:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a, skipping ID generation
2026-03-24 21:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with scrape type 1
2026-03-24 21:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a sending to next pipeline
2026-03-24 21:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a, identifier: 1980205
2026-03-24 21:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with identifier: 1980205
2026-03-24 21:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with identifier: 1980205
2026-03-24 21:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a with identifier: 1980205 to the API
2026-03-24 21:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': 'd9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Fiesta',
 'odometer': 23375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a/d9f4b5d6-9488-5f4b-bce1-f8baa53bbc8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/lb-/6c1751a6b61b4ad6a8db9dc4b87a91e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Fiesta FORD Fiesta 1.0 EcoBoost S&S Aut. TITANIUM Limousine, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Fiesta 1.0 EcoBoost S&S Aut. TITANIUM Limousine, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980205%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [ayvens.de] INFO: Saving data for 1980205: {'created_time': 1774388834.22189, 'last_price_update_time': 1774388834.2219, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980205') HTTP/1.1" 204 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/6.jpg not downloaded yet
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/7.jpg not downloaded yet
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e15410>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/9.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/8.jpg not downloaded yet
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/9.jpg not downloaded yet
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b39a50>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/8.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a4acd0>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/1.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd2cd0>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/3.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/10.jpg not downloaded yet
2026-03-24 21:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:14 [ayvens.de] INFO: Found listing with ID: 1980209
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980209%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [ayvens.de] INFO: Scrape type for 1980209: 1
2026-03-24 21:47:14 [ayvens.de] INFO: Extracting data for car ID: 1980209
2026-03-24 21:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1980209
2026-03-24 21:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 with scrape type 1
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/1.jpg not downloaded yet
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b41c10>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/7.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b38250>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/2.jpg saved to cache
2026-03-24 21:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7f390>
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/6.jpg saved to cache
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c70a50>
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/5.jpg saved to cache
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/2.jpg not downloaded yet
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/3.jpg not downloaded yet
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/4.jpg not downloaded yet
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fe190>
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-q%252F881e81c6d4a84780a0089517b53b5697%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/4.jpg saved to cache
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b2161a3-385c-582f-96c7-931fe26b726a
2026-03-24 21:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b2161a3-385c-582f-96c7-931fe26b726a, skipping ID generation
2026-03-24 21:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2161a3-385c-582f-96c7-931fe26b726a with scrape type 1
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b2161a3-385c-582f-96c7-931fe26b726a sending to next pipeline
2026-03-24 21:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4b2161a3-385c-582f-96c7-931fe26b726a, identifier: 1980206
2026-03-24 21:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4b2161a3-385c-582f-96c7-931fe26b726a with identifier: 1980206
2026-03-24 21:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4b2161a3-385c-582f-96c7-931fe26b726a with identifier: 1980206
2026-03-24 21:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4b2161a3-385c-582f-96c7-931fe26b726a with identifier: 1980206 to the API
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4b2161a3-385c-582f-96c7-931fe26b726a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 81883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2161a3-385c-582f-96c7-931fe26b726a/4b2161a3-385c-582f-96c7-931fe26b726a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-q/881e81c6d4a84780a0089517b53b5697/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat VW Passat Variant 1.4 TSI Plug-In-Hybrid DSG GTE '
          'Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Passat Variant 1.4 TSI Plug-In-Hybrid DSG GTE Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980206%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [ayvens.de] INFO: Saving data for 1980206: {'created_time': 1774388835.804556, 'last_price_update_time': 1774388835.804567, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980206') HTTP/1.1" 204 0
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/5.jpg not downloaded yet
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/6.jpg not downloaded yet
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b64350>
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/6.jpg saved to cache
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/7.jpg not downloaded yet
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abd610>
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/8.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3f3d0>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/5.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89250>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/4.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23090>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/3.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/8.jpg not downloaded yet
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/9.jpg not downloaded yet
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89890>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/1.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/10.jpg not downloaded yet
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [ayvens.de] INFO: Found listing with ID: 1980210
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980210%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [ayvens.de] INFO: Scrape type for 1980210: 1
2026-03-24 21:47:16 [ayvens.de] INFO: Extracting data for car ID: 1980210
2026-03-24 21:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1980210
2026-03-24 21:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/1.jpg not downloaded yet
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a80690>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/2.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/2.jpg not downloaded yet
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/3.jpg not downloaded yet
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/4.jpg not downloaded yet
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff6650>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/10.jpg saved to cache
2026-03-24 21:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb7b50>
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/9.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/5.jpg not downloaded yet
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/6.jpg not downloaded yet
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b29950>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/6.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d76fd0>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/7.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd6b10>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/7.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb1cd0>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/5.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/7.jpg not downloaded yet
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/8.jpg not downloaded yet
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/9.jpg not downloaded yet
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c872d0>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/9.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a117d0>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/8.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/10.jpg not downloaded yet
2026-03-24 21:47:17 [ayvens.de] INFO: Found listing with ID: 1980211
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980211%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [ayvens.de] INFO: Scrape type for 1980211: 1
2026-03-24 21:47:17 [ayvens.de] INFO: Extracting data for car ID: 1980211
2026-03-24 21:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14eef03e-e22c-5b95-9fdb-113c5eedff28 with identifier: 1980211
2026-03-24 21:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14eef03e-e22c-5b95-9fdb-113c5eedff28 with scrape type 1
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/1.jpg not downloaded yet
2026-03-24 21:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c4f590>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/3.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a11810>
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdn-%252F3792f9e3bd7b424c8c2273a396311882%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/10.jpg saved to cache
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10b025db-2342-5526-8e82-ae07c6c129d5
2026-03-24 21:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b025db-2342-5526-8e82-ae07c6c129d5, skipping ID generation
2026-03-24 21:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b025db-2342-5526-8e82-ae07c6c129d5 with scrape type 1
2026-03-24 21:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10b025db-2342-5526-8e82-ae07c6c129d5 sending to next pipeline
2026-03-24 21:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 10b025db-2342-5526-8e82-ae07c6c129d5, identifier: 1980208
2026-03-24 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/2.jpg not downloaded yet
2026-03-24 21:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 10b025db-2342-5526-8e82-ae07c6c129d5 with identifier: 1980208
2026-03-24 21:47:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 10b025db-2342-5526-8e82-ae07c6c129d5 with identifier: 1980208
2026-03-24 21:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 10b025db-2342-5526-8e82-ae07c6c129d5 with identifier: 1980208 to the API
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '10b025db-2342-5526-8e82-ae07c6c129d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 67957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b025db-2342-5526-8e82-ae07c6c129d5/10b025db-2342-5526-8e82-ae07c6c129d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dn-/3792f9e3bd7b424c8c2273a396311882/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBoost Start-Stopp-System Aut. '
          'ACTIVE X Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBoost Start-Stopp-System Aut. ACTIVE X '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980208%27 HTTP/1.1" 200 None
2026-03-24 21:47:18 [ayvens.de] INFO: Saving data for 1980208: {'created_time': 1774388838.493081, 'last_price_update_time': 1774388838.49309, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980208') HTTP/1.1" 204 0
2026-03-24 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/3.jpg not downloaded yet
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/4.jpg not downloaded yet
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fafe90>
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/4.jpg saved to cache
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7df50>
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/1.jpg saved to cache
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd1c90>
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/5.jpg saved to cache
2026-03-24 21:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a67050>
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/2.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/5.jpg not downloaded yet
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/6.jpg not downloaded yet
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b2ad90>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/7.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a821d0>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/6.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/7.jpg not downloaded yet
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/8.jpg not downloaded yet
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/9.jpg not downloaded yet
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c93cd0>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/9.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bec310>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/8.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/10.jpg not downloaded yet
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [ayvens.de] INFO: Found listing with ID: 1980212
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980212%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [ayvens.de] INFO: Scrape type for 1980212: 1
2026-03-24 21:47:19 [ayvens.de] INFO: Extracting data for car ID: 1980212
2026-03-24 21:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1980212
2026-03-24 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f595488c-ff5d-50c2-9245-9e43f0df663e with scrape type 1
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/1.jpg not downloaded yet
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d77610>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/1.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3ef10>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/3.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/2.jpg not downloaded yet
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/3.jpg not downloaded yet
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/4.jpg not downloaded yet
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce8610>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/2.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd1c50>
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgi-%252F762d1a49cbe74ea48e20bc0372fdb5fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/4.jpg saved to cache
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a6766ba-e511-57fe-8dc9-94f351bc1538
2026-03-24 21:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a6766ba-e511-57fe-8dc9-94f351bc1538, skipping ID generation
2026-03-24 21:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6766ba-e511-57fe-8dc9-94f351bc1538 with scrape type 1
2026-03-24 21:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a6766ba-e511-57fe-8dc9-94f351bc1538 sending to next pipeline
2026-03-24 21:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0a6766ba-e511-57fe-8dc9-94f351bc1538, identifier: 1980207
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd7406750>
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/4.jpg saved to cache
2026-03-24 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8268410>
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwm-%252Ffef3ef6e9d4b413eb19a90b49716684f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/10.jpg saved to cache
2026-03-24 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a18c085-c262-58bf-86cf-e9e44262cbe8
2026-03-24 21:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a18c085-c262-58bf-86cf-e9e44262cbe8, skipping ID generation
2026-03-24 21:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 with scrape type 1
2026-03-24 21:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a18c085-c262-58bf-86cf-e9e44262cbe8 sending to next pipeline
2026-03-24 21:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 2a18c085-c262-58bf-86cf-e9e44262cbe8, identifier: 1980209
2026-03-24 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0a6766ba-e511-57fe-8dc9-94f351bc1538 with identifier: 1980207
2026-03-24 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0a6766ba-e511-57fe-8dc9-94f351bc1538 with identifier: 1980207
2026-03-24 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0a6766ba-e511-57fe-8dc9-94f351bc1538 with identifier: 1980207 to the API
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a6766ba-e511-57fe-8dc9-94f351bc1538',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 119000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6766ba-e511-57fe-8dc9-94f351bc1538/0a6766ba-e511-57fe-8dc9-94f351bc1538_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gi-/762d1a49cbe74ea48e20bc0372fdb5fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat VW Passat Variant 2.0 TDI SCR Business Kombi, '
          '5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'VW Passat Variant 2.0 TDI SCR Business Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980207%27 HTTP/1.1" 200 None
2026-03-24 21:47:20 [ayvens.de] INFO: Saving data for 1980207: {'created_time': 1774388840.623689, 'last_price_update_time': 1774388840.6237, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980207') HTTP/1.1" 204 0
2026-03-24 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1980209
2026-03-24 21:47:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1980209
2026-03-24 21:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 2a18c085-c262-58bf-86cf-e9e44262cbe8 with identifier: 1980209 to the API
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Alpinwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2a18c085-c262-58bf-86cf-e9e44262cbe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 108394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a18c085-c262-58bf-86cf-e9e44262cbe8/2a18c085-c262-58bf-86cf-e9e44262cbe8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wm-/fef3ef6e9d4b413eb19a90b49716684f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 BMW X3 xDrive30e Aut. M Sport Geschlossen, 5-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW X3 xDrive30e Aut. M Sport Geschlossen, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980209%27 HTTP/1.1" 200 None
2026-03-24 21:47:20 [ayvens.de] INFO: Saving data for 1980209: {'created_time': 1774388840.976741, 'last_price_update_time': 1774388840.976751, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980209') HTTP/1.1" 204 0
2026-03-24 21:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/5.jpg not downloaded yet
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/6.jpg not downloaded yet
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23790>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/7.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a12550>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/6.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/7.jpg not downloaded yet
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/8.jpg not downloaded yet
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f6cd0>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/9.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd3a50>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/10.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/9.jpg not downloaded yet
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/10.jpg not downloaded yet
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c88210>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/5.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a83dd0>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-a%252F462ea77171914c82a8e33f750b22b96b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/8.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e43e99e6-fda1-5f2a-bce1-1804c47092dd
2026-03-24 21:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e43e99e6-fda1-5f2a-bce1-1804c47092dd, skipping ID generation
2026-03-24 21:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43e99e6-fda1-5f2a-bce1-1804c47092dd with scrape type 1
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e43e99e6-fda1-5f2a-bce1-1804c47092dd sending to next pipeline
2026-03-24 21:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e43e99e6-fda1-5f2a-bce1-1804c47092dd, identifier: 1980210
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e388d0>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/1.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b3b7d0>
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/2.jpg saved to cache
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:21 [ayvens.de] INFO: Found listing with ID: 1980213
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980213%27 HTTP/1.1" 200 None
2026-03-24 21:47:21 [ayvens.de] INFO: Scrape type for 1980213: 1
2026-03-24 21:47:21 [ayvens.de] INFO: Extracting data for car ID: 1980213
2026-03-24 21:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1980213
2026-03-24 21:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-24 21:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/1.jpg not downloaded yet
2026-03-24 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1980210
2026-03-24 21:47:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1980210
2026-03-24 21:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e43e99e6-fda1-5f2a-bce1-1804c47092dd with identifier: 1980210 to the API
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Polarwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e43e99e6-fda1-5f2a-bce1-1804c47092dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 48484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43e99e6-fda1-5f2a-bce1-1804c47092dd/e43e99e6-fda1-5f2a-bce1-1804c47092dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-a/462ea77171914c82a8e33f750b22b96b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980210%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [ayvens.de] INFO: Saving data for 1980210: {'created_time': 1774388842.364525, 'last_price_update_time': 1774388842.364536, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980210') HTTP/1.1" 204 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/2.jpg not downloaded yet
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/3.jpg not downloaded yet
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a4bc90>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/4.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb1610>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/3.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/4.jpg not downloaded yet
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/5.jpg not downloaded yet
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d08310>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/7.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf8f50>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/8.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/6.jpg not downloaded yet
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/7.jpg not downloaded yet
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/8.jpg not downloaded yet
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd0150>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/6.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d77f90>
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/9.jpg saved to cache
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/9.jpg not downloaded yet
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/10.jpg not downloaded yet
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eec8d0>
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fe162068e63de49f08202387f974caa85%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/9.jpg saved to cache
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 159e2404-facb-5ec5-829c-072720f72578
2026-03-24 21:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 159e2404-facb-5ec5-829c-072720f72578, skipping ID generation
2026-03-24 21:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159e2404-facb-5ec5-829c-072720f72578 with scrape type 1
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 159e2404-facb-5ec5-829c-072720f72578 sending to next pipeline
2026-03-24 21:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 159e2404-facb-5ec5-829c-072720f72578, identifier: 1980204
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df3d90>
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/5.jpg saved to cache
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3e890>
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/2.jpg saved to cache
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd6d10>
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/1.jpg saved to cache
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [ayvens.de] INFO: Found listing with ID: 1980214
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980214%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [ayvens.de] INFO: Scrape type for 1980214: 1
2026-03-24 21:47:23 [ayvens.de] INFO: Extracting data for car ID: 1980214
2026-03-24 21:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 035b571d-ec43-5df4-bbf2-83a1b9d95098 with identifier: 1980214
2026-03-24 21:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 035b571d-ec43-5df4-bbf2-83a1b9d95098 with scrape type 1
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/1.jpg not downloaded yet
2026-03-24 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 159e2404-facb-5ec5-829c-072720f72578 with identifier: 1980204
2026-03-24 21:47:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 159e2404-facb-5ec5-829c-072720f72578 with identifier: 1980204
2026-03-24 21:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 159e2404-facb-5ec5-829c-072720f72578 with identifier: 1980204 to the API
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '159e2404-facb-5ec5-829c-072720f72578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 198818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159e2404-facb-5ec5-829c-072720f72578/159e2404-facb-5ec5-829c-072720f72578_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/e162068e63de49f08202387f974caa85/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 35 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980204%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [ayvens.de] INFO: Saving data for 1980204: {'created_time': 1774388843.840012, 'last_price_update_time': 1774388843.840022, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980204') HTTP/1.1" 204 0
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/2.jpg not downloaded yet
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/3.jpg not downloaded yet
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd73ee390>
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/4.jpg saved to cache
2026-03-24 21:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/4.jpg not downloaded yet
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/5.jpg not downloaded yet
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eefb90>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/6.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a42f90>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/5.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3acb990>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/3.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/6.jpg not downloaded yet
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ac8910>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/9.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e3a750>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/8.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb6b90>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/7.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c05c50>
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-p%252F0258e5d95d0e4e5a8ee57ccf46a12bcf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/10.jpg saved to cache
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14eef03e-e22c-5b95-9fdb-113c5eedff28
2026-03-24 21:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14eef03e-e22c-5b95-9fdb-113c5eedff28, skipping ID generation
2026-03-24 21:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14eef03e-e22c-5b95-9fdb-113c5eedff28 with scrape type 1
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14eef03e-e22c-5b95-9fdb-113c5eedff28 sending to next pipeline
2026-03-24 21:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 14eef03e-e22c-5b95-9fdb-113c5eedff28, identifier: 1980211
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/7.jpg not downloaded yet
2026-03-24 21:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 14eef03e-e22c-5b95-9fdb-113c5eedff28 with identifier: 1980211
2026-03-24 21:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 14eef03e-e22c-5b95-9fdb-113c5eedff28 with identifier: 1980211
2026-03-24 21:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 14eef03e-e22c-5b95-9fdb-113c5eedff28 with identifier: 1980211 to the API
2026-03-24 21:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '14eef03e-e22c-5b95-9fdb-113c5eedff28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 163068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14eef03e-e22c-5b95-9fdb-113c5eedff28/14eef03e-e22c-5b95-9fdb-113c5eedff28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-p/0258e5d95d0e4e5a8ee57ccf46a12bcf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 AUDI Q5 55 TFSIe quattro S tronic S line Geschlossen, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI Q5 55 TFSIe quattro S tronic S line Geschlossen, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980211%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [ayvens.de] INFO: Saving data for 1980211: {'created_time': 1774388845.16805, 'last_price_update_time': 1774388845.168061, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980211') HTTP/1.1" 204 0
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/8.jpg not downloaded yet
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/9.jpg not downloaded yet
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/10.jpg not downloaded yet
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [ayvens.de] INFO: Found listing with ID: 1980215
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980215%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [ayvens.de] INFO: Scrape type for 1980215: 1
2026-03-24 21:47:25 [ayvens.de] INFO: Extracting data for car ID: 1980215
2026-03-24 21:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1980215
2026-03-24 21:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424e80e5-2158-5404-9f08-eae2ff66ecea with scrape type 1
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/1.jpg not downloaded yet
2026-03-24 21:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/2.jpg not downloaded yet
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/3.jpg not downloaded yet
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/4.jpg not downloaded yet
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ca78d0>
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-y%252F12c0a938c2324f57bfcb57493a4a15a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/10.jpg saved to cache
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f595488c-ff5d-50c2-9245-9e43f0df663e
2026-03-24 21:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f595488c-ff5d-50c2-9245-9e43f0df663e, skipping ID generation
2026-03-24 21:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f595488c-ff5d-50c2-9245-9e43f0df663e with scrape type 1
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f595488c-ff5d-50c2-9245-9e43f0df663e sending to next pipeline
2026-03-24 21:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f595488c-ff5d-50c2-9245-9e43f0df663e, identifier: 1980212
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/5.jpg not downloaded yet
2026-03-24 21:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1980212
2026-03-24 21:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1980212
2026-03-24 21:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f595488c-ff5d-50c2-9245-9e43f0df663e with identifier: 1980212 to the API
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Frost',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f595488c-ff5d-50c2-9245-9e43f0df663e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 58995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f595488c-ff5d-50c2-9245-9e43f0df663e/f595488c-ff5d-50c2-9245-9e43f0df663e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-y/12c0a938c2324f57bfcb57493a4a15a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus 1.5 EcoBlue Start-Stopp-System TREND '
          'Limousine, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus 1.5 EcoBlue Start-Stopp-System TREND Limousine, 5-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980212%27 HTTP/1.1" 200 None
2026-03-24 21:47:25 [ayvens.de] INFO: Saving data for 1980212: {'created_time': 1774388845.861805, 'last_price_update_time': 1774388845.861815, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980212') HTTP/1.1" 204 0
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce2b50>
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/1.jpg saved to cache
2026-03-24 21:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e16290>
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/3.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3ca50>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/2.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/6.jpg not downloaded yet
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9b0f310>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/6.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd0510>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/4.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cebe10>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/9.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8214d50>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/5.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/7.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/8.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/9.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/10.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [ayvens.de] INFO: Found listing with ID: 1980216
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980216%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [ayvens.de] INFO: Scrape type for 1980216: 1
2026-03-24 21:47:26 [ayvens.de] INFO: Extracting data for car ID: 1980216
2026-03-24 21:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1980216
2026-03-24 21:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/1.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/2.jpg not downloaded yet
2026-03-24 21:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/3.jpg not downloaded yet
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c30c10>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/10.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/4.jpg not downloaded yet
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd0b50>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/8.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a31290>
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fl-g%252Fa7c62c2bcd13436faa80258d1209358d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/8.jpg saved to cache
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb3bfb67-68c7-552f-ad4b-c4775a03e201
2026-03-24 21:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb3bfb67-68c7-552f-ad4b-c4775a03e201, skipping ID generation
2026-03-24 21:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 with scrape type 1
2026-03-24 21:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb3bfb67-68c7-552f-ad4b-c4775a03e201 sending to next pipeline
2026-03-24 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: cb3bfb67-68c7-552f-ad4b-c4775a03e201, identifier: 1980202
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/5.jpg not downloaded yet
2026-03-24 21:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1980202
2026-03-24 21:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1980202
2026-03-24 21:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: cb3bfb67-68c7-552f-ad4b-c4775a03e201 with identifier: 1980202 to the API
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb3bfb67-68c7-552f-ad4b-c4775a03e201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 60809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3bfb67-68c7-552f-ad4b-c4775a03e201/cb3bfb67-68c7-552f-ad4b-c4775a03e201_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/l-g/a7c62c2bcd13436faa80258d1209358d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 120 L2H1 3,0t Komfort Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980202%27 HTTP/1.1" 200 None
2026-03-24 21:47:27 [ayvens.de] INFO: Saving data for 1980202: {'created_time': 1774388847.436852, 'last_price_update_time': 1774388847.436862, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980202') HTTP/1.1" 204 0
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/6.jpg not downloaded yet
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dca552a50>
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/9.jpg saved to cache
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a663d0>
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/1.jpg saved to cache
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d475d0>
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fro-%252F9aced55b782c4ccab253a1b87d9ed544%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/7.jpg saved to cache
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e731dd25-76e8-5724-931b-52a262f9cb61
2026-03-24 21:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e731dd25-76e8-5724-931b-52a262f9cb61, skipping ID generation
2026-03-24 21:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e731dd25-76e8-5724-931b-52a262f9cb61 with scrape type 1
2026-03-24 21:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e731dd25-76e8-5724-931b-52a262f9cb61 sending to next pipeline
2026-03-24 21:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e731dd25-76e8-5724-931b-52a262f9cb61, identifier: 1980213
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d38d0>
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/3.jpg saved to cache
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dca77d310>
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/2.jpg saved to cache
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1980213
2026-03-24 21:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1980213
2026-03-24 21:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e731dd25-76e8-5724-931b-52a262f9cb61 with identifier: 1980213 to the API
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Brillantschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e731dd25-76e8-5724-931b-52a262f9cb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 80099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e731dd25-76e8-5724-931b-52a262f9cb61/e731dd25-76e8-5724-931b-52a262f9cb61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ro-/9aced55b782c4ccab253a1b87d9ed544/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, '
          '7-Gang',
 'transmission': 'automatic',
 'trim': 'AUDI A4 Avant 30 TDI S tronic Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980213%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [ayvens.de] INFO: Saving data for 1980213: {'created_time': 1774388848.512435, 'last_price_update_time': 1774388848.512445, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980213') HTTP/1.1" 204 0
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/7.jpg not downloaded yet
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/8.jpg not downloaded yet
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/9.jpg not downloaded yet
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/10.jpg not downloaded yet
2026-03-24 21:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:28 [ayvens.de] INFO: Found listing with ID: 1980217
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980217%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [ayvens.de] INFO: Scrape type for 1980217: 1
2026-03-24 21:47:28 [ayvens.de] INFO: Extracting data for car ID: 1980217
2026-03-24 21:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with identifier: 1980217
2026-03-24 21:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with scrape type 1
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/1.jpg not downloaded yet
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/2.jpg not downloaded yet
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/3.jpg not downloaded yet
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c28a90>
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/8.jpg saved to cache
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/4.jpg not downloaded yet
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc8ad0>
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/7.jpg saved to cache
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/5.jpg not downloaded yet
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/6.jpg not downloaded yet
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2710>
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/6.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd1390>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/6.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c86c10>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/5.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc826ac90>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/4.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c86190>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/9.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c04550>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/3.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/7.jpg not downloaded yet
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/8.jpg not downloaded yet
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/9.jpg not downloaded yet
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/10.jpg not downloaded yet
2026-03-24 21:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:29 [ayvens.de] INFO: Found listing with ID: 1980218
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980218%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [ayvens.de] INFO: Scrape type for 1980218: 1
2026-03-24 21:47:29 [ayvens.de] INFO: Extracting data for car ID: 1980218
2026-03-24 21:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73883570-acd3-57bd-a7ef-3a1e8021ea01 with identifier: 1980218
2026-03-24 21:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73883570-acd3-57bd-a7ef-3a1e8021ea01 with scrape type 1
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/1.jpg not downloaded yet
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/2.jpg not downloaded yet
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/3.jpg not downloaded yet
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d55310>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/2.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c90e10>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/8.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a20490>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/10.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d575d0>
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/7.jpg saved to cache
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/4.jpg not downloaded yet
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1acd0>
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/1.jpg saved to cache
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dd8590>
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252F72d025cd83894e6b80d3ffe4e6c2374b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/9.jpg saved to cache
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 424e80e5-2158-5404-9f08-eae2ff66ecea
2026-03-24 21:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 424e80e5-2158-5404-9f08-eae2ff66ecea, skipping ID generation
2026-03-24 21:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424e80e5-2158-5404-9f08-eae2ff66ecea with scrape type 1
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 424e80e5-2158-5404-9f08-eae2ff66ecea sending to next pipeline
2026-03-24 21:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 424e80e5-2158-5404-9f08-eae2ff66ecea, identifier: 1980215
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc359f3d0>
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/6.jpg saved to cache
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f39410>
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/5.jpg saved to cache
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/5.jpg not downloaded yet
2026-03-24 21:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1980215
2026-03-24 21:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1980215
2026-03-24 21:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 424e80e5-2158-5404-9f08-eae2ff66ecea with identifier: 1980215 to the API
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '424e80e5-2158-5404-9f08-eae2ff66ecea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 186955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424e80e5-2158-5404-9f08-eae2ff66ecea/424e80e5-2158-5404-9f08-eae2ff66ecea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/72d025cd83894e6b80d3ffe4e6c2374b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.0 EcoBlue S&S Aut. TITANIUM Kombi, '
          '5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.0 EcoBlue S&S Aut. TITANIUM Kombi, 5-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980215%27 HTTP/1.1" 200 None
2026-03-24 21:47:30 [ayvens.de] INFO: Saving data for 1980215: {'created_time': 1774388850.995221, 'last_price_update_time': 1774388850.995233, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980215') HTTP/1.1" 204 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/6.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/7.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/8.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/9.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/10.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [ayvens.de] INFO: Found listing with ID: 1980219
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980219%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [ayvens.de] INFO: Scrape type for 1980219: 1
2026-03-24 21:47:31 [ayvens.de] INFO: Extracting data for car ID: 1980219
2026-03-24 21:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with identifier: 1980219
2026-03-24 21:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with scrape type 1
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/1.jpg not downloaded yet
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/2.jpg not downloaded yet
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cb6610>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/5.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df1a50>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/4.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eeca90>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/3.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/3.jpg not downloaded yet
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc7e90>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/1.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a13110>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/2.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/4.jpg not downloaded yet
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/5.jpg not downloaded yet
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ba0990>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/7.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7dd50>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/10.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cae410>
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/4.jpg saved to cache
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/6.jpg not downloaded yet
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/7.jpg not downloaded yet
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/8.jpg not downloaded yet
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/9.jpg not downloaded yet
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/10.jpg not downloaded yet
2026-03-24 21:47:32 [ayvens.de] INFO: Found listing with ID: 1980220
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980220%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [ayvens.de] INFO: Scrape type for 1980220: 1
2026-03-24 21:47:32 [ayvens.de] INFO: Extracting data for car ID: 1980220
2026-03-24 21:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a22743e7-afd1-5918-9d54-9b99df669e8f with identifier: 1980220
2026-03-24 21:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a22743e7-afd1-5918-9d54-9b99df669e8f with scrape type 1
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/1.jpg not downloaded yet
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/2.jpg not downloaded yet
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7ebd0>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/6.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b66f10>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/8.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b29590>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/7.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/3.jpg not downloaded yet
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c74a90>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/9.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd2bd0>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/3.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd4710>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/8.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc0590>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/4.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/4.jpg not downloaded yet
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/5.jpg not downloaded yet
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dca1d0>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/3.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/6.jpg not downloaded yet
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/7.jpg not downloaded yet
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aca810>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/5.jpg saved to cache
2026-03-24 21:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe2390>
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/6.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/8.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/9.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/10.jpg not downloaded yet
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a83fd0>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/7.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe3190>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/1.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e16e90>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/2.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a3b990>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/8.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ac8950>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/2.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8d150>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/3.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:33 [ayvens.de] INFO: Found listing with ID: 1980221
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980221%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [ayvens.de] INFO: Scrape type for 1980221: 1
2026-03-24 21:47:33 [ayvens.de] INFO: Extracting data for car ID: 1980221
2026-03-24 21:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1980221
2026-03-24 21:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26e2664-7e50-51e0-9964-f34a1a67d48b with scrape type 1
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/1.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/2.jpg not downloaded yet
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/3.jpg not downloaded yet
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/4.jpg not downloaded yet
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/5.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/6.jpg not downloaded yet
2026-03-24 21:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/7.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/8.jpg not downloaded yet
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/9.jpg not downloaded yet
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38650>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/6.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c16750>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/3.jpg saved to cache
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/10.jpg not downloaded yet
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdc4d0>
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/1.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bcc090>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/10.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1b4d0>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/5.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb2ad0>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/2.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1b390>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/4.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [ayvens.de] INFO: Found listing with ID: 1980222
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980222%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [ayvens.de] INFO: Scrape type for 1980222: 1
2026-03-24 21:47:34 [ayvens.de] INFO: Extracting data for car ID: 1980222
2026-03-24 21:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1980222
2026-03-24 21:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311d83dc-371b-5211-95e8-9555407fe223 with scrape type 1
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/1.jpg not downloaded yet
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/2.jpg not downloaded yet
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a82250>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/9.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/3.jpg not downloaded yet
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/4.jpg not downloaded yet
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb4590>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/8.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff4810>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/4.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/5.jpg not downloaded yet
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/6.jpg not downloaded yet
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/7.jpg not downloaded yet
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a207d0>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/10.jpg saved to cache
2026-03-24 21:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bbb110>
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/7.jpg saved to cache
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df21d0>
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F3136f95b44634306966455f9445cc8c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/1.jpg saved to cache
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3
2026-03-24 21:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c0961e9-3d81-59e9-b594-b37dc2483ad3, skipping ID generation
2026-03-24 21:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with scrape type 1
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c0961e9-3d81-59e9-b594-b37dc2483ad3 sending to next pipeline
2026-03-24 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3c0961e9-3d81-59e9-b594-b37dc2483ad3, identifier: 1980219
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f053d0>
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252Fe14b4e1b0e7646608875274457d2815f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/9.jpg saved to cache
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73883570-acd3-57bd-a7ef-3a1e8021ea01
2026-03-24 21:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73883570-acd3-57bd-a7ef-3a1e8021ea01, skipping ID generation
2026-03-24 21:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73883570-acd3-57bd-a7ef-3a1e8021ea01 with scrape type 1
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73883570-acd3-57bd-a7ef-3a1e8021ea01 sending to next pipeline
2026-03-24 21:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 73883570-acd3-57bd-a7ef-3a1e8021ea01, identifier: 1980218
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a91a90>
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/5.jpg saved to cache
2026-03-24 21:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with identifier: 1980219
2026-03-24 21:47:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with identifier: 1980219
2026-03-24 21:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3c0961e9-3d81-59e9-b594-b37dc2483ad3 with identifier: 1980219 to the API
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '3c0961e9-3d81-59e9-b594-b37dc2483ad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Custom',
 'odometer': 128660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0961e9-3d81-59e9-b594-b37dc2483ad3/3c0961e9-3d81-59e9-b594-b37dc2483ad3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/3136f95b44634306966455f9445cc8c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit Custom FORD Transit Custom 300 L2H1 LKW VA Trend '
          'Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Custom 300 L2H1 LKW VA Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980219%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [ayvens.de] INFO: Saving data for 1980219: {'created_time': 1774388856.026658, 'last_price_update_time': 1774388856.026668, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980219') HTTP/1.1" 204 0
2026-03-24 21:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 73883570-acd3-57bd-a7ef-3a1e8021ea01 with identifier: 1980218
2026-03-24 21:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 73883570-acd3-57bd-a7ef-3a1e8021ea01 with identifier: 1980218
2026-03-24 21:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 73883570-acd3-57bd-a7ef-3a1e8021ea01 with identifier: 1980218 to the API
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '73883570-acd3-57bd-a7ef-3a1e8021ea01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 198034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73883570-acd3-57bd-a7ef-3a1e8021ea01/73883570-acd3-57bd-a7ef-3a1e8021ea01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/e14b4e1b0e7646608875274457d2815f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 240 L2 S&S Sport Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 240 L2 S&S Sport Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980218%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [ayvens.de] INFO: Saving data for 1980218: {'created_time': 1774388856.45312, 'last_price_update_time': 1774388856.453129, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980218') HTTP/1.1" 204 0
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/8.jpg not downloaded yet
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b0bcd0>
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/8.jpg saved to cache
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/9.jpg not downloaded yet
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/10.jpg not downloaded yet
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [ayvens.de] INFO: Found listing with ID: 1980223
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980223%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [ayvens.de] INFO: Scrape type for 1980223: 1
2026-03-24 21:47:36 [ayvens.de] INFO: Extracting data for car ID: 1980223
2026-03-24 21:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with identifier: 1980223
2026-03-24 21:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with scrape type 1
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/1.jpg not downloaded yet
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35e3bd0>
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/2.jpg saved to cache
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/2.jpg not downloaded yet
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/3.jpg not downloaded yet
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c22450>
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/1.jpg saved to cache
2026-03-24 21:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe2390>
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/3.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d0a790>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/10.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c20f50>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/9.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/4.jpg not downloaded yet
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/5.jpg not downloaded yet
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/6.jpg not downloaded yet
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a31990>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/1.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cae8d0>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/10.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e15390>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/7.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/7.jpg not downloaded yet
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/8.jpg not downloaded yet
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/9.jpg not downloaded yet
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/10.jpg not downloaded yet
2026-03-24 21:47:37 [ayvens.de] INFO: Found listing with ID: 1980224
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980224%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [ayvens.de] INFO: Scrape type for 1980224: 1
2026-03-24 21:47:37 [ayvens.de] INFO: Extracting data for car ID: 1980224
2026-03-24 21:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d98199-9c54-516e-b7ce-c8a165d65483 with identifier: 1980224
2026-03-24 21:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d98199-9c54-516e-b7ce-c8a165d65483 with scrape type 1
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/1.jpg not downloaded yet
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/2.jpg not downloaded yet
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2caecd0>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/8.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a32790>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/9.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/3.jpg not downloaded yet
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/4.jpg not downloaded yet
2026-03-24 21:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/5.jpg not downloaded yet
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c92c50>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/6.jpg saved to cache
2026-03-24 21:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fd5910>
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/7.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c04950>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/2.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb6650>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/5.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f7710>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/4.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc0d90>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/3.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/6.jpg not downloaded yet
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/7.jpg not downloaded yet
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc81d39d0>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/8.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/8.jpg not downloaded yet
2026-03-24 21:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/9.jpg not downloaded yet
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/10.jpg not downloaded yet
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d089d0>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/7.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc2350>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/10.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99f03d0>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/6.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3daa750>
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fmed%252F02b1f469293e4499b508bacec97196ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/9.jpg saved to cache
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 311d83dc-371b-5211-95e8-9555407fe223
2026-03-24 21:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 311d83dc-371b-5211-95e8-9555407fe223, skipping ID generation
2026-03-24 21:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311d83dc-371b-5211-95e8-9555407fe223 with scrape type 1
2026-03-24 21:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 311d83dc-371b-5211-95e8-9555407fe223 sending to next pipeline
2026-03-24 21:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 311d83dc-371b-5211-95e8-9555407fe223, identifier: 1980222
2026-03-24 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1980222
2026-03-24 21:47:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1980222
2026-03-24 21:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 311d83dc-371b-5211-95e8-9555407fe223 with identifier: 1980222 to the API
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Gelb',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '311d83dc-371b-5211-95e8-9555407fe223',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 146564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_311d83dc-371b-5211-95e8-9555407fe223/311d83dc-371b-5211-95e8-9555407fe223_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/med/02b1f469293e4499b508bacec97196ab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 CRDi Eco-Dynamics+ (48V Mild-Hybrid) SPIRIT '
          'Geschlossen, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'KIA XCeed 1.6 CRDi Eco-Dynamics+ (48V Mild-Hybrid) SPIRIT '
         'Geschlossen, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980222%27 HTTP/1.1" 200 None
2026-03-24 21:47:39 [ayvens.de] INFO: Saving data for 1980222: {'created_time': 1774388859.557968, 'last_price_update_time': 1774388859.557978, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980222') HTTP/1.1" 204 0
2026-03-24 21:47:39 [ayvens.de] INFO: Found listing with ID: 1980225
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980225%27 HTTP/1.1" 200 None
2026-03-24 21:47:39 [ayvens.de] INFO: Scrape type for 1980225: 1
2026-03-24 21:47:39 [ayvens.de] INFO: Extracting data for car ID: 1980225
2026-03-24 21:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8230de16-5739-558d-a8be-7a3f65694525 with identifier: 1980225
2026-03-24 21:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8230de16-5739-558d-a8be-7a3f65694525 with scrape type 1
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/1.jpg not downloaded yet
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/2.jpg not downloaded yet
2026-03-24 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d8ed50>
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/5.jpg saved to cache
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a43b90>
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/1.jpg saved to cache
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bddc90>
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/4.jpg saved to cache
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/3.jpg not downloaded yet
2026-03-24 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/4.jpg not downloaded yet
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a432d0>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/6.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/5.jpg not downloaded yet
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/6.jpg not downloaded yet
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a191d0>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/5.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ed9d0>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/8.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/7.jpg not downloaded yet
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/8.jpg not downloaded yet
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/9.jpg not downloaded yet
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df1cd0>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/7.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc3850>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/1.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3da8b90>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/3.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca5790>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/2.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/10.jpg not downloaded yet
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [ayvens.de] INFO: Found listing with ID: 1980226
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980226%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [ayvens.de] INFO: Scrape type for 1980226: 1
2026-03-24 21:47:40 [ayvens.de] INFO: Extracting data for car ID: 1980226
2026-03-24 21:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1980226
2026-03-24 21:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a19b732-745f-542c-b084-ad80d302a120 with scrape type 1
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/1.jpg not downloaded yet
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9adee90>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/10.jpg saved to cache
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/2.jpg not downloaded yet
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/3.jpg not downloaded yet
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/4.jpg not downloaded yet
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a05590>
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/5.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/5.jpg not downloaded yet
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/6.jpg not downloaded yet
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b2b5d0>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/6.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bf9e90>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/4.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d092d0>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/9.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/7.jpg not downloaded yet
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/8.jpg not downloaded yet
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/9.jpg not downloaded yet
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bfa550>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/8.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38090>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/10.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a13b10>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/3.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38950>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/7.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/10.jpg not downloaded yet
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb1050>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/1.jpg saved to cache
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:41 [ayvens.de] INFO: Found listing with ID: 1980227
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980227%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [ayvens.de] INFO: Scrape type for 1980227: 1
2026-03-24 21:47:41 [ayvens.de] INFO: Extracting data for car ID: 1980227
2026-03-24 21:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with identifier: 1980227
2026-03-24 21:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with scrape type 1
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/1.jpg not downloaded yet
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/2.jpg not downloaded yet
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/3.jpg not downloaded yet
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce9690>
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/3.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc2a50>
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/4.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cfa950>
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/2.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/4.jpg not downloaded yet
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/5.jpg not downloaded yet
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd1390>
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffd-%252F113e67c8d9d44a43bef9fc4f0955271f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/9.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63d98199-9c54-516e-b7ce-c8a165d65483
2026-03-24 21:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63d98199-9c54-516e-b7ce-c8a165d65483, skipping ID generation
2026-03-24 21:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d98199-9c54-516e-b7ce-c8a165d65483 with scrape type 1
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63d98199-9c54-516e-b7ce-c8a165d65483 sending to next pipeline
2026-03-24 21:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 63d98199-9c54-516e-b7ce-c8a165d65483, identifier: 1980224
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a106d0>
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/5.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c07910>
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F7ec706dcbda348b199e17525532ffe2f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/2.jpg saved to cache
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626
2026-03-24 21:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626, skipping ID generation
2026-03-24 21:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with scrape type 1
2026-03-24 21:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 sending to next pipeline
2026-03-24 21:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626, identifier: 1980223
2026-03-24 21:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f39b50>
2026-03-24 21:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/7.jpg saved to cache
2026-03-24 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/6.jpg not downloaded yet
2026-03-24 21:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 63d98199-9c54-516e-b7ce-c8a165d65483 with identifier: 1980224
2026-03-24 21:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 63d98199-9c54-516e-b7ce-c8a165d65483 with identifier: 1980224
2026-03-24 21:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 63d98199-9c54-516e-b7ce-c8a165d65483 with identifier: 1980224 to the API
2026-03-24 21:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '63d98199-9c54-516e-b7ce-c8a165d65483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 175707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d98199-9c54-516e-b7ce-c8a165d65483/63d98199-9c54-516e-b7ce-c8a165d65483_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fd-/113e67c8d9d44a43bef9fc4f0955271f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran VW Touran 2.0 TDI SCR DSG ACTIVE Kombi, 5-türig, '
          'Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'VW Touran 2.0 TDI SCR DSG ACTIVE Kombi, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980224%27 HTTP/1.1" 200 None
2026-03-24 21:47:44 [ayvens.de] INFO: Saving data for 1980224: {'created_time': 1774388864.431444, 'last_price_update_time': 1774388864.431458, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980224') HTTP/1.1" 204 0
2026-03-24 21:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with identifier: 1980223
2026-03-24 21:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with identifier: 1980223
2026-03-24 21:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626 with identifier: 1980223 to the API
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse',
 'odometer': 208881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626/8dd91eb5-48e5-5d3e-93c8-b5e1f04c7626_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/7ec706dcbda348b199e17525532ffe2f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse MERCEDES-BENZ C 220 d T 9G-TRONIC AMG Line '
          'Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ C 220 d T 9G-TRONIC AMG Line Kombi, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980223%27 HTTP/1.1" 200 None
2026-03-24 21:47:44 [ayvens.de] INFO: Saving data for 1980223: {'created_time': 1774388864.820937, 'last_price_update_time': 1774388864.820949, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980223') HTTP/1.1" 204 0
2026-03-24 21:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/7.jpg not downloaded yet
2026-03-24 21:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/8.jpg not downloaded yet
2026-03-24 21:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3acb6d0>
2026-03-24 21:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/9.jpg saved to cache
2026-03-24 21:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/9.jpg not downloaded yet
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/10.jpg not downloaded yet
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc826aa90>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/10.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd2d10>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/8.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c056d0>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/1.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:45 [ayvens.de] INFO: Found listing with ID: 1980228
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980228%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [ayvens.de] INFO: Scrape type for 1980228: 1
2026-03-24 21:47:45 [ayvens.de] INFO: Extracting data for car ID: 1980228
2026-03-24 21:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4973f995-ea38-5178-83d2-7cacbcc1349c with identifier: 1980228
2026-03-24 21:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4973f995-ea38-5178-83d2-7cacbcc1349c with scrape type 1
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/1.jpg not downloaded yet
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/2.jpg not downloaded yet
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/3.jpg not downloaded yet
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/4.jpg not downloaded yet
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/5.jpg not downloaded yet
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/6.jpg not downloaded yet
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/7.jpg not downloaded yet
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/8.jpg not downloaded yet
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c2c310>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/4.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d87910>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/7.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/9.jpg not downloaded yet
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c85690>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/6.jpg saved to cache
2026-03-24 21:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cd06d0>
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/5.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a818d0>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/3.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/10.jpg not downloaded yet
2026-03-24 21:47:46 [ayvens.de] INFO: Found listing with ID: 1980229
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980229%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [ayvens.de] INFO: Scrape type for 1980229: 1
2026-03-24 21:47:46 [ayvens.de] INFO: Extracting data for car ID: 1980229
2026-03-24 21:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b95ac3a4-745f-56c2-816e-11c86908f898 with identifier: 1980229
2026-03-24 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b95ac3a4-745f-56c2-816e-11c86908f898 with scrape type 1
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/1.jpg not downloaded yet
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c15c90>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/10.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe9650>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/9.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca4d50>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/8.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/2.jpg not downloaded yet
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/3.jpg not downloaded yet
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/4.jpg not downloaded yet
2026-03-24 21:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/5.jpg not downloaded yet
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/6.jpg not downloaded yet
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/7.jpg not downloaded yet
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/8.jpg not downloaded yet
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eec590>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/3.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a93610>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/5.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ad6e50>
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-c%252F3651613e8a9f4489953e4bc26427f33e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/2.jpg saved to cache
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a19b732-745f-542c-b084-ad80d302a120
2026-03-24 21:47:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a19b732-745f-542c-b084-ad80d302a120, skipping ID generation
2026-03-24 21:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a19b732-745f-542c-b084-ad80d302a120 with scrape type 1
2026-03-24 21:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a19b732-745f-542c-b084-ad80d302a120 sending to next pipeline
2026-03-24 21:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8a19b732-745f-542c-b084-ad80d302a120, identifier: 1980226
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/9.jpg not downloaded yet
2026-03-24 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1980226
2026-03-24 21:47:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1980226
2026-03-24 21:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8a19b732-745f-542c-b084-ad80d302a120 with identifier: 1980226 to the API
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '8a19b732-745f-542c-b084-ad80d302a120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 217282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a19b732-745f-542c-b084-ad80d302a120/8a19b732-745f-542c-b084-ad80d302a120_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-c/3651613e8a9f4489953e4bc26427f33e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 2.0 TDI SCR DSG R-Line '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 2.0 TDI SCR DSG R-Line Kombi, 5-türig, '
         'Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980226%27 HTTP/1.1" 200 None
2026-03-24 21:47:47 [ayvens.de] INFO: Saving data for 1980226: {'created_time': 1774388867.561841, 'last_price_update_time': 1774388867.561855, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980226') HTTP/1.1" 204 0
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a3b690>
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/4.jpg saved to cache
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1cc10>
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/7.jpg saved to cache
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a22010>
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/1.jpg saved to cache
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c04e90>
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbi-%252F9a5f268e077240a8b34dfb3a777e02a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/6.jpg saved to cache
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8230de16-5739-558d-a8be-7a3f65694525
2026-03-24 21:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8230de16-5739-558d-a8be-7a3f65694525, skipping ID generation
2026-03-24 21:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8230de16-5739-558d-a8be-7a3f65694525 with scrape type 1
2026-03-24 21:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8230de16-5739-558d-a8be-7a3f65694525 sending to next pipeline
2026-03-24 21:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8230de16-5739-558d-a8be-7a3f65694525, identifier: 1980225
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dd7406590>
2026-03-24 21:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/2.jpg saved to cache
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/10.jpg not downloaded yet
2026-03-24 21:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8230de16-5739-558d-a8be-7a3f65694525 with identifier: 1980225
2026-03-24 21:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8230de16-5739-558d-a8be-7a3f65694525 with identifier: 1980225
2026-03-24 21:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8230de16-5739-558d-a8be-7a3f65694525 with identifier: 1980225 to the API
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '8230de16-5739-558d-a8be-7a3f65694525',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.3',
 'odometer': 78870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8230de16-5739-558d-a8be-7a3f65694525/8230de16-5739-558d-a8be-7a3f65694525_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bi-/9a5f268e077240a8b34dfb3a777e02a0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.3 VW ID.3 Pro S (5-Sitzer) Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'VW ID.3 Pro S (5-Sitzer) Limousine, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980225%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [ayvens.de] INFO: Saving data for 1980225: {'created_time': 1774388868.657421, 'last_price_update_time': 1774388868.657433, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980225') HTTP/1.1" 204 0
2026-03-24 21:47:48 [ayvens.de] INFO: Found listing with ID: 1980120
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980120%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [ayvens.de] INFO: Scrape type for 1980120: 1
2026-03-24 21:47:48 [ayvens.de] INFO: Extracting data for car ID: 1980120
2026-03-24 21:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1980120
2026-03-24 21:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/1.jpg not downloaded yet
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/2.jpg not downloaded yet
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/3.jpg not downloaded yet
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/4.jpg not downloaded yet
2026-03-24 21:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/5.jpg not downloaded yet
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/6.jpg not downloaded yet
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/7.jpg not downloaded yet
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/8.jpg not downloaded yet
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35fee50>
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/1.jpg saved to cache
2026-03-24 21:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bc3a10>
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/2.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b55110>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/8.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/9.jpg not downloaded yet
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c86b50>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/9.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/10.jpg not downloaded yet
2026-03-24 21:47:49 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a38d10>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/10.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f7fd0>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/3.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd9e10>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/8.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff5f50>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/9.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c28550>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/2.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ce9990>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/10.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eca910>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/1.jpg saved to cache
2026-03-24 21:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eb8c50>
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/7.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eb9950>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/9.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f2e4d0>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/6.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f2cd50>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/8.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e7cd50>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/7.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5f650>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/6.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f08550>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/2.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ceaa10>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/10.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3af95d0>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/9.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e17f90>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/5.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f0bd90>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/4.jpg saved to cache
2026-03-24 21:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb5510>
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/3.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fadc10>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/8.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ad53d0>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/10.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a11990>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/1.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdc490>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/7.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd0450>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/6.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e16c90>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/5.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b66690>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ftf-%252F05ba036881104bc0b3a12c1b0957cb97%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/4.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f26e2664-7e50-51e0-9964-f34a1a67d48b
2026-03-24 21:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26e2664-7e50-51e0-9964-f34a1a67d48b, skipping ID generation
2026-03-24 21:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26e2664-7e50-51e0-9964-f34a1a67d48b with scrape type 1
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f26e2664-7e50-51e0-9964-f34a1a67d48b sending to next pipeline
2026-03-24 21:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f26e2664-7e50-51e0-9964-f34a1a67d48b, identifier: 1980221
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7c750>
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/4.jpg saved to cache
2026-03-24 21:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1980221
2026-03-24 21:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1980221
2026-03-24 21:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f26e2664-7e50-51e0-9964-f34a1a67d48b with identifier: 1980221 to the API
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': 'f26e2664-7e50-51e0-9964-f34a1a67d48b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'i10',
 'odometer': 29770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26e2664-7e50-51e0-9964-f34a1a67d48b/f26e2664-7e50-51e0-9964-f34a1a67d48b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/tf-/05ba036881104bc0b3a12c1b0957cb97/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI i10 HYUNDAI i10 1.0 Trend Limousine, 5-türig, 5-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI i10 1.0 Trend Limousine, 5-türig, 5-Gang',
 'vin': None,
 'year': 2019}
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980221%27 HTTP/1.1" 200 None
2026-03-24 21:47:52 [ayvens.de] INFO: Saving data for 1980221: {'created_time': 1774388872.414429, 'last_price_update_time': 1774388872.414438, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980221') HTTP/1.1" 204 0
2026-03-24 21:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8217250>
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fe6a52c6a07314b2c98e4fb6f23b4aebb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/6.jpg saved to cache
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76
2026-03-24 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76, skipping ID generation
2026-03-24 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with scrape type 1
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 sending to next pipeline
2026-03-24 21:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76, identifier: 1980227
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5db10>
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F6e90d980c2b84c95929068ef58887656%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/4.jpg saved to cache
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67a42d01-bd07-5f99-a038-a43f584794fa
2026-03-24 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a42d01-bd07-5f99-a038-a43f584794fa, skipping ID generation
2026-03-24 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a42d01-bd07-5f99-a038-a43f584794fa with scrape type 1
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a42d01-bd07-5f99-a038-a43f584794fa sending to next pipeline
2026-03-24 21:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 67a42d01-bd07-5f99-a038-a43f584794fa, identifier: 1980120
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35e1150>
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhsk%252F7494c899395d48f9b63b7585ed478c45%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/3.jpg saved to cache
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b95ac3a4-745f-56c2-816e-11c86908f898
2026-03-24 21:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b95ac3a4-745f-56c2-816e-11c86908f898, skipping ID generation
2026-03-24 21:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b95ac3a4-745f-56c2-816e-11c86908f898 with scrape type 1
2026-03-24 21:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b95ac3a4-745f-56c2-816e-11c86908f898 sending to next pipeline
2026-03-24 21:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b95ac3a4-745f-56c2-816e-11c86908f898, identifier: 1980229
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35e0890>
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhro%252Fcd7a705ee2754620a529fc94d6673122%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/5.jpg saved to cache
2026-03-24 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4973f995-ea38-5178-83d2-7cacbcc1349c
2026-03-24 21:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4973f995-ea38-5178-83d2-7cacbcc1349c, skipping ID generation
2026-03-24 21:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4973f995-ea38-5178-83d2-7cacbcc1349c with scrape type 1
2026-03-24 21:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4973f995-ea38-5178-83d2-7cacbcc1349c sending to next pipeline
2026-03-24 21:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4973f995-ea38-5178-83d2-7cacbcc1349c, identifier: 1980228
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with identifier: 1980227
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with identifier: 1980227
2026-03-24 21:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 47a1fe5a-26ff-5d3b-8274-c0993e00eb76 with identifier: 1980227 to the API
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Solid Black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '47a1fe5a-26ff-5d3b-8274-c0993e00eb76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model 3',
 'odometer': 47135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a1fe5a-26ff-5d3b-8274-c0993e00eb76/47a1fe5a-26ff-5d3b-8274-c0993e00eb76_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/e6a52c6a07314b2c98e4fb6f23b4aebb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model 3 TESLA Model 3 RWD Hinterradantrieb Limousine, '
          '4-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model 3 RWD Hinterradantrieb Limousine, 4-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980227%27 HTTP/1.1" 200 None
2026-03-24 21:47:53 [ayvens.de] INFO: Saving data for 1980227: {'created_time': 1774388873.533688, 'last_price_update_time': 1774388873.533697, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980227') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1980120
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1980120
2026-03-24 21:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 67a42d01-bd07-5f99-a038-a43f584794fa with identifier: 1980120 to the API
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '67a42d01-bd07-5f99-a038-a43f584794fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Arteon',
 'odometer': 120756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a42d01-bd07-5f99-a038-a43f584794fa/67a42d01-bd07-5f99-a038-a43f584794fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/6e90d980c2b84c95929068ef58887656/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Arteon VW Arteon Shooting Brake 1.4 eHybrid OPF DSG '
          'R-Line Kombi, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'VW Arteon Shooting Brake 1.4 eHybrid OPF DSG R-Line Kombi, 5-türig, '
         'Automatik, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980120%27 HTTP/1.1" 200 None
2026-03-24 21:47:53 [ayvens.de] INFO: Saving data for 1980120: {'created_time': 1774388873.868517, 'last_price_update_time': 1774388873.868527, 'auction_closing_time': 1774443600.0}
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980120') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b95ac3a4-745f-56c2-816e-11c86908f898 with identifier: 1980229
2026-03-24 21:47:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b95ac3a4-745f-56c2-816e-11c86908f898 with identifier: 1980229
2026-03-24 21:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b95ac3a4-745f-56c2-816e-11c86908f898 with identifier: 1980229 to the API
2026-03-24 21:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'Schiefer',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b95ac3a4-745f-56c2-816e-11c86908f898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Master III',
 'odometer': 293440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b95ac3a4-745f-56c2-816e-11c86908f898/b95ac3a4-745f-56c2-816e-11c86908f898_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hsk/7494c899395d48f9b63b7585ed478c45/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Master III RENAULT Master ENERGY dCi 165 L4H3 HA '
          'Grossr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Master ENERGY dCi 165 L4H3 HA Grossr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980229%27 HTTP/1.1" 200 None
2026-03-24 21:47:54 [ayvens.de] INFO: Saving data for 1980229: {'created_time': 1774388874.242773, 'last_price_update_time': 1774388874.242783, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980229') HTTP/1.1" 204 0
2026-03-24 21:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4973f995-ea38-5178-83d2-7cacbcc1349c with identifier: 1980228
2026-03-24 21:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4973f995-ea38-5178-83d2-7cacbcc1349c with identifier: 1980228
2026-03-24 21:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4973f995-ea38-5178-83d2-7cacbcc1349c with identifier: 1980228 to the API
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '4973f995-ea38-5178-83d2-7cacbcc1349c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic 2019',
 'odometer': 143137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4973f995-ea38-5178-83d2-7cacbcc1349c/4973f995-ea38-5178-83d2-7cacbcc1349c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hro/cd7a705ee2754620a529fc94d6673122/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT Trafic 2019 RENAULT Trafic ENERGY dCi 145 L2H1 3.0t Komfort '
          'Doppelk.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Trafic ENERGY dCi 145 L2H1 3.0t Komfort Doppelk.Kasten, '
         '4-türig, 6-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980228%27 HTTP/1.1" 200 None
2026-03-24 21:47:54 [ayvens.de] INFO: Saving data for 1980228: {'created_time': 1774388874.665878, 'last_price_update_time': 1774388874.66589, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980228') HTTP/1.1" 204 0
2026-03-24 21:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35cdb50>
2026-03-24 21:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F69c063a672a94ab5b66070b2d0d05991%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/6.jpg saved to cache
2026-03-24 21:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a22743e7-afd1-5918-9d54-9b99df669e8f
2026-03-24 21:47:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a22743e7-afd1-5918-9d54-9b99df669e8f, skipping ID generation
2026-03-24 21:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a22743e7-afd1-5918-9d54-9b99df669e8f with scrape type 1
2026-03-24 21:47:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a22743e7-afd1-5918-9d54-9b99df669e8f sending to next pipeline
2026-03-24 21:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a22743e7-afd1-5918-9d54-9b99df669e8f, identifier: 1980220
2026-03-24 21:47:54 [ayvens.de] INFO: Found listing with ID: 1980121
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980121%27 HTTP/1.1" 200 None
2026-03-24 21:47:54 [ayvens.de] INFO: Scrape type for 1980121: 1
2026-03-24 21:47:54 [ayvens.de] INFO: Extracting data for car ID: 1980121
2026-03-24 21:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89eba119-9763-5108-8bd1-7722fe51d76b with identifier: 1980121
2026-03-24 21:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89eba119-9763-5108-8bd1-7722fe51d76b with scrape type 1
2026-03-24 21:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/1.jpg not downloaded yet
2026-03-24 21:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a22743e7-afd1-5918-9d54-9b99df669e8f with identifier: 1980220
2026-03-24 21:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a22743e7-afd1-5918-9d54-9b99df669e8f with identifier: 1980220
2026-03-24 21:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a22743e7-afd1-5918-9d54-9b99df669e8f with identifier: 1980220 to the API
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a22743e7-afd1-5918-9d54-9b99df669e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Custom',
 'odometer': 202080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a22743e7-afd1-5918-9d54-9b99df669e8f/a22743e7-afd1-5918-9d54-9b99df669e8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/69c063a672a94ab5b66070b2d0d05991/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 6,
 'seller_name': None,
 'title': 'FORD Transit Custom FORD Transit Custom 320 L2H1 LKW VA MH Trend '
          'Doppelk.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Custom 320 L2H1 LKW VA MH Trend Doppelk.Kasten, '
         '4-türig, 6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980220%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [ayvens.de] INFO: Saving data for 1980220: {'created_time': 1774388875.251999, 'last_price_update_time': 1774388875.25201, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980220') HTTP/1.1" 204 0
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/2.jpg not downloaded yet
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d57d50>
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/10.jpg saved to cache
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/3.jpg not downloaded yet
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/4.jpg not downloaded yet
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/5.jpg not downloaded yet
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/6.jpg not downloaded yet
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/7.jpg not downloaded yet
2026-03-24 21:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/8.jpg not downloaded yet
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/9.jpg not downloaded yet
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c893d0>
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhvl%252F4278e05b69b04b559c20f7e93a7225e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/9.jpg saved to cache
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148
2026-03-24 21:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 603e233b-c3a3-5fb9-9371-94ea7d9f3148, skipping ID generation
2026-03-24 21:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with scrape type 1
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 603e233b-c3a3-5fb9-9371-94ea7d9f3148 sending to next pipeline
2026-03-24 21:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 603e233b-c3a3-5fb9-9371-94ea7d9f3148, identifier: 1980217
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1f950>
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/2.jpg saved to cache
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/10.jpg not downloaded yet
2026-03-24 21:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with identifier: 1980217
2026-03-24 21:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with identifier: 1980217
2026-03-24 21:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 603e233b-c3a3-5fb9-9371-94ea7d9f3148 with identifier: 1980217 to the API
2026-03-24 21:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '603e233b-c3a3-5fb9-9371-94ea7d9f3148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 165508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603e233b-c3a3-5fb9-9371-94ea7d9f3148/603e233b-c3a3-5fb9-9371-94ea7d9f3148_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hvl/4278e05b69b04b559c20f7e93a7225e5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 240 L2 LKW Trend Kombi, '
          '5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 240 L2 LKW Trend Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980217%27 HTTP/1.1" 200 None
2026-03-24 21:47:56 [ayvens.de] INFO: Saving data for 1980217: {'created_time': 1774388876.210526, 'last_price_update_time': 1774388876.210537, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980217') HTTP/1.1" 204 0
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fb7d90>
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/10.jpg saved to cache
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb0d50>
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F9e9ff3cacfdf427192401b04259efb10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/1.jpg saved to cache
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9ac5b8f-83b7-5935-9efe-bd6038786488
2026-03-24 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9ac5b8f-83b7-5935-9efe-bd6038786488, skipping ID generation
2026-03-24 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ac5b8f-83b7-5935-9efe-bd6038786488 with scrape type 1
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9ac5b8f-83b7-5935-9efe-bd6038786488 sending to next pipeline
2026-03-24 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: e9ac5b8f-83b7-5935-9efe-bd6038786488, identifier: 1980216
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b64450>
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/5.jpg saved to cache
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bbe610>
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252Fddadcf1391a547f8bec3d2e690807816%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/4.jpg saved to cache
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 035b571d-ec43-5df4-bbf2-83a1b9d95098
2026-03-24 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 035b571d-ec43-5df4-bbf2-83a1b9d95098, skipping ID generation
2026-03-24 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 035b571d-ec43-5df4-bbf2-83a1b9d95098 with scrape type 1
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 035b571d-ec43-5df4-bbf2-83a1b9d95098 sending to next pipeline
2026-03-24 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 035b571d-ec43-5df4-bbf2-83a1b9d95098, identifier: 1980214
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3f0b710>
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F24340698dbda4604a34e16f6a986b69f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/10.jpg saved to cache
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e
2026-03-24 21:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e, skipping ID generation
2026-03-24 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with scrape type 1
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e sending to next pipeline
2026-03-24 21:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e, identifier: 1980201
2026-03-24 21:47:56 [ayvens.de] INFO: Found listing with ID: 1980122
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980122%27 HTTP/1.1" 200 None
2026-03-24 21:47:56 [ayvens.de] INFO: Scrape type for 1980122: 1
2026-03-24 21:47:56 [ayvens.de] INFO: Extracting data for car ID: 1980122
2026-03-24 21:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1980122
2026-03-24 21:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-24 21:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/1.jpg not downloaded yet
2026-03-24 21:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1980216
2026-03-24 21:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1980216
2026-03-24 21:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: e9ac5b8f-83b7-5935-9efe-bd6038786488 with identifier: 1980216 to the API
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9ac5b8f-83b7-5935-9efe-bd6038786488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 43283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9ac5b8f-83b7-5935-9efe-bd6038786488/e9ac5b8f-83b7-5935-9efe-bd6038786488_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/9e9ff3cacfdf427192401b04259efb10/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980216%27 HTTP/1.1" 200 None
2026-03-24 21:47:57 [ayvens.de] INFO: Saving data for 1980216: {'created_time': 1774388877.359209, 'last_price_update_time': 1774388877.359221, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980216') HTTP/1.1" 204 0
2026-03-24 21:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 035b571d-ec43-5df4-bbf2-83a1b9d95098 with identifier: 1980214
2026-03-24 21:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 035b571d-ec43-5df4-bbf2-83a1b9d95098 with identifier: 1980214
2026-03-24 21:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 035b571d-ec43-5df4-bbf2-83a1b9d95098 with identifier: 1980214 to the API
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '035b571d-ec43-5df4-bbf2-83a1b9d95098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 126746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 988068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1006713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 936461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 993211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 978349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 910769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 977557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_035b571d-ec43-5df4-bbf2-83a1b9d95098/035b571d-ec43-5df4-bbf2-83a1b9d95098_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 878733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/ddadcf1391a547f8bec3d2e690807816/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System '
          'COOL&CONNECT Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System COOL&CONNECT '
         'Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2019}
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980214%27 HTTP/1.1" 200 None
2026-03-24 21:47:57 [ayvens.de] INFO: Saving data for 1980214: {'created_time': 1774388877.765209, 'last_price_update_time': 1774388877.76522, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980214') HTTP/1.1" 204 0
2026-03-24 21:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with identifier: 1980201
2026-03-24 21:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with identifier: 1980201
2026-03-24 21:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e with identifier: 1980201 to the API
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 75514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e/43df5bc5-e9f4-5e6d-ab0b-8fdb6b4d117e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/24340698dbda4604a34e16f6a986b69f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour BLUE dCi 115 BUSINESS '
          'EDITION Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour BLUE dCi 115 BUSINESS EDITION Kombi, '
         '5-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980201%27 HTTP/1.1" 200 None
2026-03-24 21:47:58 [ayvens.de] INFO: Saving data for 1980201: {'created_time': 1774388878.105652, 'last_price_update_time': 1774388878.105662, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980201') HTTP/1.1" 204 0
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c92150>
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fr-t%252F20b0a48320c84dfe94a72a4e2ed1c9d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/9.jpg saved to cache
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487
2026-03-24 21:47:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dbe4ae8-5673-5770-b8f9-9eb29a777487, skipping ID generation
2026-03-24 21:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with scrape type 1
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dbe4ae8-5673-5770-b8f9-9eb29a777487 sending to next pipeline
2026-03-24 21:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0dbe4ae8-5673-5770-b8f9-9eb29a777487, identifier: 1980195
2026-03-24 21:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/2.jpg not downloaded yet
2026-03-24 21:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with identifier: 1980195
2026-03-24 21:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with identifier: 1980195
2026-03-24 21:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0dbe4ae8-5673-5770-b8f9-9eb29a777487 with identifier: 1980195 to the API
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Solid Black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '0dbe4ae8-5673-5770-b8f9-9eb29a777487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'Model Y',
 'odometer': 63939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dbe4ae8-5673-5770-b8f9-9eb29a777487/0dbe4ae8-5673-5770-b8f9-9eb29a777487_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/r-t/20b0a48320c84dfe94a72a4e2ed1c9d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA Model Y TESLA Model Y Long Range Dual Motor AWD Geschlossen, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'TESLA Model Y Long Range Dual Motor AWD Geschlossen, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980195%27 HTTP/1.1" 200 None
2026-03-24 21:47:58 [ayvens.de] INFO: Saving data for 1980195: {'created_time': 1774388878.659362, 'last_price_update_time': 1774388878.659372, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980195') HTTP/1.1" 204 0
2026-03-24 21:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/3.jpg not downloaded yet
2026-03-24 21:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/4.jpg not downloaded yet
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3befad0>
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwi-%252Fc0b17478d11f447fb8e7fa1e83e73875%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/6.jpg saved to cache
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2
2026-03-24 21:47:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2, skipping ID generation
2026-03-24 21:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with scrape type 1
2026-03-24 21:47:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 sending to next pipeline
2026-03-24 21:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2, identifier: 1980184
2026-03-24 21:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with identifier: 1980184
2026-03-24 21:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with identifier: 1980184
2026-03-24 21:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2 with identifier: 1980184 to the API
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 49522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2/fb33f1ab-9a3b-5253-ac27-b7a0275c2ad2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wi-/c0b17478d11f447fb8e7fa1e83e73875/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Dual Motor 78kWh Limousine, '
          '5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Dual Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980184%27 HTTP/1.1" 200 None
2026-03-24 21:47:59 [ayvens.de] INFO: Saving data for 1980184: {'created_time': 1774388879.312268, 'last_price_update_time': 1774388879.31228, 'auction_closing_time': 1774447200.0}
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980184') HTTP/1.1" 204 0
2026-03-24 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/5.jpg not downloaded yet
2026-03-24 21:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/6.jpg not downloaded yet
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c13390>
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fne-%252F6929048248dc4186949bee4f992235d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/4.jpg saved to cache
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a386865-df63-5812-bba1-69e5c3f5561c
2026-03-24 21:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a386865-df63-5812-bba1-69e5c3f5561c, skipping ID generation
2026-03-24 21:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a386865-df63-5812-bba1-69e5c3f5561c with scrape type 1
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a386865-df63-5812-bba1-69e5c3f5561c sending to next pipeline
2026-03-24 21:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6a386865-df63-5812-bba1-69e5c3f5561c, identifier: 1980186
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dbaa10>
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/8.jpg saved to cache
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd3ad0>
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fg-d%252Fbe9e373d6a30468fa93566f26190717e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/7.jpg saved to cache
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40
2026-03-24 21:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40, skipping ID generation
2026-03-24 21:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with scrape type 1
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 sending to next pipeline
2026-03-24 21:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40, identifier: 1980183
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd6810>
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpm-%252F74304179770e4b9e8b696e0ed0ee45ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/1.jpg saved to cache
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40
2026-03-24 21:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 821fb8fd-92cb-5795-8fc5-b972e1f94b40, skipping ID generation
2026-03-24 21:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with scrape type 1
2026-03-24 21:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 821fb8fd-92cb-5795-8fc5-b972e1f94b40 sending to next pipeline
2026-03-24 21:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 821fb8fd-92cb-5795-8fc5-b972e1f94b40, identifier: 1980180
2026-03-24 21:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6a386865-df63-5812-bba1-69e5c3f5561c with identifier: 1980186
2026-03-24 21:47:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6a386865-df63-5812-bba1-69e5c3f5561c with identifier: 1980186
2026-03-24 21:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6a386865-df63-5812-bba1-69e5c3f5561c with identifier: 1980186 to the API
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '6a386865-df63-5812-bba1-69e5c3f5561c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'Polestar 2',
 'odometer': 118933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a386865-df63-5812-bba1-69e5c3f5561c/6a386865-df63-5812-bba1-69e5c3f5561c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ne-/6929048248dc4186949bee4f992235d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR Polestar 2 POLESTAR Polestar 2 Single Motor 78kWh '
          'Limousine, 5-türig, Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'POLESTAR Polestar 2 Single Motor 78kWh Limousine, 5-türig, '
         'Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980186%27 HTTP/1.1" 200 None
2026-03-24 21:48:00 [ayvens.de] INFO: Saving data for 1980186: {'created_time': 1774388880.534867, 'last_price_update_time': 1774388880.534877, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980186') HTTP/1.1" 204 0
2026-03-24 21:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with identifier: 1980183
2026-03-24 21:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with identifier: 1980183
2026-03-24 21:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3d6af01a-3f37-5e27-b9a9-7b7f5e552f40 with identifier: 1980183 to the API
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d6af01a-3f37-5e27-b9a9-7b7f5e552f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Grandland X',
 'odometer': 106832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d6af01a-3f37-5e27-b9a9-7b7f5e552f40/3d6af01a-3f37-5e27-b9a9-7b7f5e552f40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/g-d/be9e373d6a30468fa93566f26190717e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL Grandland X OPEL Grandland X 1.5 D Start/Stop INNOVATION '
          'Geschlossen, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'OPEL Grandland X 1.5 D Start/Stop INNOVATION Geschlossen, 5-türig, '
         '6-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980183%27 HTTP/1.1" 200 None
2026-03-24 21:48:00 [ayvens.de] INFO: Saving data for 1980183: {'created_time': 1774388880.923482, 'last_price_update_time': 1774388880.923492, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980183') HTTP/1.1" 204 0
2026-03-24 21:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with identifier: 1980180
2026-03-24 21:48:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with identifier: 1980180
2026-03-24 21:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 821fb8fd-92cb-5795-8fc5-b972e1f94b40 with identifier: 1980180 to the API
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '821fb8fd-92cb-5795-8fc5-b972e1f94b40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 52035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_821fb8fd-92cb-5795-8fc5-b972e1f94b40/821fb8fd-92cb-5795-8fc5-b972e1f94b40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pm-/74304179770e4b9e8b696e0ed0ee45ac/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBoost Start-Stopp-System Aut. '
          'ST-LINE X Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBoost Start-Stopp-System Aut. ST-LINE X '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980180%27 HTTP/1.1" 200 None
2026-03-24 21:48:01 [ayvens.de] INFO: Saving data for 1980180: {'created_time': 1774388881.281584, 'last_price_update_time': 1774388881.281594, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980180') HTTP/1.1" 204 0
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/7.jpg not downloaded yet
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c4c710>
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fdh-%252Fbc0675f5c5cb4f1ea81cd03981b0c12f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/10.jpg saved to cache
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25eea541-2574-501b-9ba3-02a08bac5b48
2026-03-24 21:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25eea541-2574-501b-9ba3-02a08bac5b48, skipping ID generation
2026-03-24 21:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eea541-2574-501b-9ba3-02a08bac5b48 with scrape type 1
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25eea541-2574-501b-9ba3-02a08bac5b48 sending to next pipeline
2026-03-24 21:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 25eea541-2574-501b-9ba3-02a08bac5b48, identifier: 1980179
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ae3d0>
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Ff53adc1bde6e4d5f95b677ae5bf4548c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/7.jpg saved to cache
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0902de47-6f5e-519e-ac51-b0abd31d65ab
2026-03-24 21:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0902de47-6f5e-519e-ac51-b0abd31d65ab, skipping ID generation
2026-03-24 21:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0902de47-6f5e-519e-ac51-b0abd31d65ab with scrape type 1
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0902de47-6f5e-519e-ac51-b0abd31d65ab sending to next pipeline
2026-03-24 21:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0902de47-6f5e-519e-ac51-b0abd31d65ab, identifier: 1980182
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d9bc10>
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-r%252F0bcb6411a6dd40e5a4e9e648aaa38a7d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/3.jpg saved to cache
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58272ba5-fb70-5efc-9858-587283c32002
2026-03-24 21:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58272ba5-fb70-5efc-9858-587283c32002, skipping ID generation
2026-03-24 21:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58272ba5-fb70-5efc-9858-587283c32002 with scrape type 1
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58272ba5-fb70-5efc-9858-587283c32002 sending to next pipeline
2026-03-24 21:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 58272ba5-fb70-5efc-9858-587283c32002, identifier: 1980178
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/8.jpg not downloaded yet
2026-03-24 21:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 25eea541-2574-501b-9ba3-02a08bac5b48 with identifier: 1980179
2026-03-24 21:48:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 25eea541-2574-501b-9ba3-02a08bac5b48 with identifier: 1980179
2026-03-24 21:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 25eea541-2574-501b-9ba3-02a08bac5b48 with identifier: 1980179 to the API
2026-03-24 21:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '25eea541-2574-501b-9ba3-02a08bac5b48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 54831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eea541-2574-501b-9ba3-02a08bac5b48/25eea541-2574-501b-9ba3-02a08bac5b48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/dh-/bc0675f5c5cb4f1ea81cd03981b0c12f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'ST-LINE Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. ST-LINE '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980179%27 HTTP/1.1" 200 None
2026-03-24 21:48:02 [ayvens.de] INFO: Saving data for 1980179: {'created_time': 1774388882.170612, 'last_price_update_time': 1774388882.170624, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980179') HTTP/1.1" 204 0
2026-03-24 21:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0902de47-6f5e-519e-ac51-b0abd31d65ab with identifier: 1980182
2026-03-24 21:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0902de47-6f5e-519e-ac51-b0abd31d65ab with identifier: 1980182
2026-03-24 21:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0902de47-6f5e-519e-ac51-b0abd31d65ab with identifier: 1980182 to the API
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '0902de47-6f5e-519e-ac51-b0abd31d65ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Corsa',
 'odometer': 45665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0902de47-6f5e-519e-ac51-b0abd31d65ab/0902de47-6f5e-519e-ac51-b0abd31d65ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/f53adc1bde6e4d5f95b677ae5bf4548c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL Corsa OPEL Corsa 1.2 Start/Stop Edition Limousine, 5-türig, '
          '5-Gang',
 'transmission': 'manual',
 'trim': 'OPEL Corsa 1.2 Start/Stop Edition Limousine, 5-türig, 5-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980182%27 HTTP/1.1" 200 None
2026-03-24 21:48:02 [ayvens.de] INFO: Saving data for 1980182: {'created_time': 1774388882.505122, 'last_price_update_time': 1774388882.505133, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980182') HTTP/1.1" 204 0
2026-03-24 21:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 58272ba5-fb70-5efc-9858-587283c32002 with identifier: 1980178
2026-03-24 21:48:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 58272ba5-fb70-5efc-9858-587283c32002 with identifier: 1980178
2026-03-24 21:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 58272ba5-fb70-5efc-9858-587283c32002 with identifier: 1980178 to the API
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '58272ba5-fb70-5efc-9858-587283c32002',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 65458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58272ba5-fb70-5efc-9858-587283c32002/58272ba5-fb70-5efc-9858-587283c32002_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-r/0bcb6411a6dd40e5a4e9e648aaa38a7d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. TITANIUM X '
          'Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. TITANIUM X Kombi, '
         '5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980178%27 HTTP/1.1" 200 None
2026-03-24 21:48:02 [ayvens.de] INFO: Saving data for 1980178: {'created_time': 1774388882.950599, 'last_price_update_time': 1774388882.950608, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980178') HTTP/1.1" 204 0
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/9.jpg not downloaded yet
2026-03-24 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/10.jpg not downloaded yet
2026-03-24 21:48:03 [ayvens.de] INFO: Found listing with ID: 1980123
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980123%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [ayvens.de] INFO: Scrape type for 1980123: 1
2026-03-24 21:48:03 [ayvens.de] INFO: Extracting data for car ID: 1980123
2026-03-24 21:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a907d38b-4f8f-514b-a9b6-d0200278f042 with identifier: 1980123
2026-03-24 21:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a907d38b-4f8f-514b-a9b6-d0200278f042 with scrape type 1
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/1.jpg not downloaded yet
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/2.jpg not downloaded yet
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/3.jpg not downloaded yet
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/4.jpg not downloaded yet
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c146d0>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/2.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c58b50>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/3.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ed090>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/1.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/5.jpg not downloaded yet
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/6.jpg not downloaded yet
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/7.jpg not downloaded yet
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5f2d0>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/5.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a1b4d0>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/1.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a22610>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/10.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c9a150>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/9.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a0ead0>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/8.jpg saved to cache
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/8.jpg not downloaded yet
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/9.jpg not downloaded yet
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/10.jpg not downloaded yet
2026-03-24 21:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:03 [ayvens.de] INFO: Found listing with ID: 1980124
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980124%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [ayvens.de] INFO: Scrape type for 1980124: 1
2026-03-24 21:48:03 [ayvens.de] INFO: Extracting data for car ID: 1980124
2026-03-24 21:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1980124
2026-03-24 21:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/1.jpg not downloaded yet
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/2.jpg not downloaded yet
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b08850>
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/2.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b0a9d0>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/6.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/3.jpg not downloaded yet
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdf690>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/3.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/4.jpg not downloaded yet
2026-03-24 21:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/5.jpg not downloaded yet
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dcad50>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/7.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b670d0>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/4.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c77c90>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/5.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fc00d0>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/5.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/6.jpg not downloaded yet
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ecfd0>
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fla-%252F5b1d40daea0f4912b642b023549dd688%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/4.jpg saved to cache
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89eba119-9763-5108-8bd1-7722fe51d76b
2026-03-24 21:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89eba119-9763-5108-8bd1-7722fe51d76b, skipping ID generation
2026-03-24 21:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89eba119-9763-5108-8bd1-7722fe51d76b with scrape type 1
2026-03-24 21:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89eba119-9763-5108-8bd1-7722fe51d76b sending to next pipeline
2026-03-24 21:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 89eba119-9763-5108-8bd1-7722fe51d76b, identifier: 1980121
2026-03-24 21:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 89eba119-9763-5108-8bd1-7722fe51d76b with identifier: 1980121
2026-03-24 21:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 89eba119-9763-5108-8bd1-7722fe51d76b with identifier: 1980121
2026-03-24 21:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 89eba119-9763-5108-8bd1-7722fe51d76b with identifier: 1980121 to the API
2026-03-24 21:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '89eba119-9763-5108-8bd1-7722fe51d76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 83892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89eba119-9763-5108-8bd1-7722fe51d76b/89eba119-9763-5108-8bd1-7722fe51d76b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/la-/5b1d40daea0f4912b642b023549dd688/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 BMW X3 xDrive30e Aut. Geschlossen, 5-türig, Automatik, '
          '8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW X3 xDrive30e Aut. Geschlossen, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980121%27 HTTP/1.1" 200 None
2026-03-24 21:48:05 [ayvens.de] INFO: Saving data for 1980121: {'created_time': 1774388885.196406, 'last_price_update_time': 1774388885.196429, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980121') HTTP/1.1" 204 0
2026-03-24 21:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/7.jpg not downloaded yet
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ee5d0>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/8.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ad7710>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/9.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/8.jpg not downloaded yet
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/9.jpg not downloaded yet
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/10.jpg not downloaded yet
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c30cd0>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/7.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a30bd0>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/10.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1c290>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/5.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e62d10>
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fslz%252Fcee4db65422d485abb9a3aee7868aa98%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/6.jpg saved to cache
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d72b9397-852a-5550-89f5-edd56a131f9a
2026-03-24 21:48:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d72b9397-852a-5550-89f5-edd56a131f9a, skipping ID generation
2026-03-24 21:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72b9397-852a-5550-89f5-edd56a131f9a with scrape type 1
2026-03-24 21:48:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d72b9397-852a-5550-89f5-edd56a131f9a sending to next pipeline
2026-03-24 21:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d72b9397-852a-5550-89f5-edd56a131f9a, identifier: 1980122
2026-03-24 21:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1980122
2026-03-24 21:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1980122
2026-03-24 21:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d72b9397-852a-5550-89f5-edd56a131f9a with identifier: 1980122 to the API
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd72b9397-852a-5550-89f5-edd56a131f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Discovery Sport',
 'odometer': 64253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72b9397-852a-5550-89f5-edd56a131f9a/d72b9397-852a-5550-89f5-edd56a131f9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/slz/cee4db65422d485abb9a3aee7868aa98/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Discovery Sport LAND ROVER Discovery Sport P300e '
          'R-Dynamic S Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Discovery Sport P300e R-Dynamic S Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980122%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [ayvens.de] INFO: Saving data for 1980122: {'created_time': 1774388886.431009, 'last_price_update_time': 1774388886.431021, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980122') HTTP/1.1" 204 0
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 80 items (at 42 items/min)
2026-03-24 21:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-24 21:48:06 [ayvens.de] INFO: Found listing with ID: 1980125
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980125%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [ayvens.de] INFO: Scrape type for 1980125: 1
2026-03-24 21:48:06 [ayvens.de] INFO: Extracting data for car ID: 1980125
2026-03-24 21:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1980125
2026-03-24 21:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with scrape type 1
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/1.jpg not downloaded yet
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/2.jpg not downloaded yet
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d53650>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/4.jpg saved to cache
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/3.jpg not downloaded yet
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/4.jpg not downloaded yet
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d54d50>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/3.jpg saved to cache
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/5.jpg not downloaded yet
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3af9f90>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/7.jpg saved to cache
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eb9010>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/6.jpg saved to cache
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/6.jpg not downloaded yet
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a2e750>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/8.jpg saved to cache
2026-03-24 21:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fad210>
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/9.jpg saved to cache
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/7.jpg not downloaded yet
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/8.jpg not downloaded yet
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a130d0>
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/2.jpg saved to cache
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bb9090>
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/1.jpg saved to cache
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c75590>
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fohz%252F57fbf7cf60e84cecb7f91a71a3877cfd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/10.jpg saved to cache
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a907d38b-4f8f-514b-a9b6-d0200278f042
2026-03-24 21:48:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a907d38b-4f8f-514b-a9b6-d0200278f042, skipping ID generation
2026-03-24 21:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a907d38b-4f8f-514b-a9b6-d0200278f042 with scrape type 1
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a907d38b-4f8f-514b-a9b6-d0200278f042 sending to next pipeline
2026-03-24 21:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a907d38b-4f8f-514b-a9b6-d0200278f042, identifier: 1980123
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a907d38b-4f8f-514b-a9b6-d0200278f042 with identifier: 1980123
2026-03-24 21:48:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a907d38b-4f8f-514b-a9b6-d0200278f042 with identifier: 1980123
2026-03-24 21:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a907d38b-4f8f-514b-a9b6-d0200278f042 with identifier: 1980123 to the API
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a907d38b-4f8f-514b-a9b6-d0200278f042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Evoque',
 'odometer': 51189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907d38b-4f8f-514b-a9b6-d0200278f042/a907d38b-4f8f-514b-a9b6-d0200278f042_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ohz/57fbf7cf60e84cecb7f91a71a3877cfd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Evoque LAND ROVER Range Rover Evoque P300e '
          'SE Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Evoque P300e SE Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980123%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [ayvens.de] INFO: Saving data for 1980123: {'created_time': 1774388887.73391, 'last_price_update_time': 1774388887.733919, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980123') HTTP/1.1" 204 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/9.jpg not downloaded yet
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%C3%BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/kün/810e6f9c4d4a4451be9734aaa386a8cc/images/large/10.jpg not downloaded yet
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a90e90>
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/3.jpg saved to cache
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:07 [ayvens.de] INFO: Found listing with ID: 1980126
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980126%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [ayvens.de] INFO: Scrape type for 1980126: 1
2026-03-24 21:48:07 [ayvens.de] INFO: Extracting data for car ID: 1980126
2026-03-24 21:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8c4dc1-cabb-59de-934f-670d0d4d4957 with identifier: 1980126
2026-03-24 21:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8c4dc1-cabb-59de-934f-670d0d4d4957 with scrape type 1
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/1.jpg not downloaded yet
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/2.jpg not downloaded yet
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c70b50>
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/4.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ab2390>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/5.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/3.jpg not downloaded yet
2026-03-24 21:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/4.jpg not downloaded yet
2026-03-24 21:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf84d0>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/2.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a06150>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/1.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b0b250>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/6.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/5.jpg not downloaded yet
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/6.jpg not downloaded yet
2026-03-24 21:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/7.jpg not downloaded yet
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8269190>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/8.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ed210>
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-i%252Fd0995eccb729400faa4f83bd54f122fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/4.jpg saved to cache
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cad24eb-6fab-5360-bd5e-94f2310260ee
2026-03-24 21:48:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cad24eb-6fab-5360-bd5e-94f2310260ee, skipping ID generation
2026-03-24 21:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cad24eb-6fab-5360-bd5e-94f2310260ee with scrape type 1
2026-03-24 21:48:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cad24eb-6fab-5360-bd5e-94f2310260ee sending to next pipeline
2026-03-24 21:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 4cad24eb-6fab-5360-bd5e-94f2310260ee, identifier: 1980177
2026-03-24 21:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 4cad24eb-6fab-5360-bd5e-94f2310260ee with identifier: 1980177
2026-03-24 21:48:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 4cad24eb-6fab-5360-bd5e-94f2310260ee with identifier: 1980177
2026-03-24 21:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 4cad24eb-6fab-5360-bd5e-94f2310260ee with identifier: 1980177 to the API
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '4cad24eb-6fab-5360-bd5e-94f2310260ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 59797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cad24eb-6fab-5360-bd5e-94f2310260ee/4cad24eb-6fab-5360-bd5e-94f2310260ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-i/d0995eccb729400faa4f83bd54f122fb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE '
          'VIGNALE Kombi, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.0 EcoBoost Hybrid Aut. ST-LINE VIGNALE Kombi, '
         '5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980177%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [ayvens.de] INFO: Saving data for 1980177: {'created_time': 1774388889.057987, 'last_price_update_time': 1774388889.057997, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980177') HTTP/1.1" 204 0
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/8.jpg not downloaded yet
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/9.jpg not downloaded yet
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cb0790>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/9.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35eda10>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/10.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/10.jpg not downloaded yet
2026-03-24 21:48:09 [ayvens.de] INFO: Found listing with ID: 1980127
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980127%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [ayvens.de] INFO: Scrape type for 1980127: 1
2026-03-24 21:48:09 [ayvens.de] INFO: Extracting data for car ID: 1980127
2026-03-24 21:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3024b217-0310-558a-b4f7-fff41e284346 with identifier: 1980127
2026-03-24 21:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3024b217-0310-558a-b4f7-fff41e284346 with scrape type 1
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/1.jpg not downloaded yet
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a12310>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/1.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7c610>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/3.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23bd0>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/4.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/2.jpg not downloaded yet
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/3.jpg not downloaded yet
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d98590>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/2.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/4.jpg not downloaded yet
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/5.jpg not downloaded yet
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/6.jpg not downloaded yet
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a98810>
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fan-%252F7b4b7423efde4f619a423839fa26bac6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/7.jpg saved to cache
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66796465-7353-572a-9087-319a58d72a35
2026-03-24 21:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66796465-7353-572a-9087-319a58d72a35, skipping ID generation
2026-03-24 21:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66796465-7353-572a-9087-319a58d72a35 with scrape type 1
2026-03-24 21:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66796465-7353-572a-9087-319a58d72a35 sending to next pipeline
2026-03-24 21:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 66796465-7353-572a-9087-319a58d72a35, identifier: 1980124
2026-03-24 21:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ec350>
2026-03-24 21:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/8.jpg saved to cache
2026-03-24 21:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1980124
2026-03-24 21:48:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1980124
2026-03-24 21:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 66796465-7353-572a-9087-319a58d72a35 with identifier: 1980124 to the API
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'color': 'Fuji White uni',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'hybrid',
 'id': '66796465-7353-572a-9087-319a58d72a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Velar',
 'odometer': 86665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66796465-7353-572a-9087-319a58d72a35/66796465-7353-572a-9087-319a58d72a35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/an-/7b4b7423efde4f619a423839fa26bac6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Velar LAND ROVER Range Rover Velar P400e '
          'R-Dynamic Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Velar P400e R-Dynamic Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980124%27 HTTP/1.1" 200 None
2026-03-24 21:48:11 [ayvens.de] INFO: Saving data for 1980124: {'created_time': 1774388891.090162, 'last_price_update_time': 1774388891.090176, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980124') HTTP/1.1" 204 0
2026-03-24 21:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/7.jpg not downloaded yet
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/8.jpg not downloaded yet
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b09750>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/5.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99e3910>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/7.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5350>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/9.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd6bd0>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/10.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3baeb10>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/1.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/9.jpg not downloaded yet
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/10.jpg not downloaded yet
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bdf450>
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fk%25C3%25BCn%252F810e6f9c4d4a4451be9734aaa386a8cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/6.jpg saved to cache
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a
2026-03-24 21:48:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a, skipping ID generation
2026-03-24 21:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with scrape type 1
2026-03-24 21:48:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee4b8be7-2931-55e9-9fa1-3da8ca2f764a sending to next pipeline
2026-03-24 21:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a, identifier: 1980125
2026-03-24 21:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1980125
2026-03-24 21:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1980125
2026-03-24 21:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ee4b8be7-2931-55e9-9fa1-3da8ca2f764a with identifier: 1980125 to the API
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee4b8be7-2931-55e9-9fa1-3da8ca2f764a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2er Gran Coupe',
 'odometer': 119189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4b8be7-2931-55e9-9fa1-3da8ca2f764a/ee4b8be7-2931-55e9-9fa1-3da8ca2f764a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/k%C3%BCn/810e6f9c4d4a4451be9734aaa386a8cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er Gran Coupe BMW 216d Gran Coupe  Aut. Advantage Coupe, '
          '5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 216d Gran Coupe  Aut. Advantage Coupe, 5-türig, Automatik, '
         '7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980125%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [ayvens.de] INFO: Saving data for 1980125: {'created_time': 1774388892.258106, 'last_price_update_time': 1774388892.258116, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980125') HTTP/1.1" 204 0
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [ayvens.de] INFO: Found listing with ID: 1980128
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980128%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [ayvens.de] INFO: Scrape type for 1980128: 1
2026-03-24 21:48:12 [ayvens.de] INFO: Extracting data for car ID: 1980128
2026-03-24 21:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14cb2abe-d760-5280-9120-2693c248e507 with identifier: 1980128
2026-03-24 21:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cb2abe-d760-5280-9120-2693c248e507 with scrape type 1
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/1.jpg not downloaded yet
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/2.jpg not downloaded yet
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/3.jpg not downloaded yet
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/4.jpg not downloaded yet
2026-03-24 21:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/5.jpg not downloaded yet
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/6.jpg not downloaded yet
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c91f10>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/2.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/7.jpg not downloaded yet
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/8.jpg not downloaded yet
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/9.jpg not downloaded yet
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3915650>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/3.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3eed750>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/6.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c21710>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/8.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9718590>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/7.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d77250>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/5.jpg saved to cache
2026-03-24 21:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe9250>
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/9.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c23490>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/4.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/10.jpg not downloaded yet
2026-03-24 21:48:13 [ayvens.de] INFO: Found listing with ID: 1980129
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980129%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [ayvens.de] INFO: Scrape type for 1980129: 1
2026-03-24 21:48:13 [ayvens.de] INFO: Extracting data for car ID: 1980129
2026-03-24 21:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1980129
2026-03-24 21:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/1.jpg not downloaded yet
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/2.jpg not downloaded yet
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/3.jpg not downloaded yet
2026-03-24 21:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/4.jpg not downloaded yet
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/5.jpg not downloaded yet
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/6.jpg not downloaded yet
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/7.jpg not downloaded yet
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c20f10>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/1.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/8.jpg not downloaded yet
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f5910>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/8.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a56ad0>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/4.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d096d0>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/5.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/9.jpg not downloaded yet
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/10.jpg not downloaded yet
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35cfb90>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/2.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd5f10>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/3.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd5fd0>
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F4c2398b0e69848129cd60d91235fcd75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/10.jpg saved to cache
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea8c4dc1-cabb-59de-934f-670d0d4d4957
2026-03-24 21:48:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea8c4dc1-cabb-59de-934f-670d0d4d4957, skipping ID generation
2026-03-24 21:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8c4dc1-cabb-59de-934f-670d0d4d4957 with scrape type 1
2026-03-24 21:48:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea8c4dc1-cabb-59de-934f-670d0d4d4957 sending to next pipeline
2026-03-24 21:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ea8c4dc1-cabb-59de-934f-670d0d4d4957, identifier: 1980126
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bec3d0>
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/7.jpg saved to cache
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ea8c4dc1-cabb-59de-934f-670d0d4d4957 with identifier: 1980126
2026-03-24 21:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ea8c4dc1-cabb-59de-934f-670d0d4d4957 with identifier: 1980126
2026-03-24 21:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ea8c4dc1-cabb-59de-934f-670d0d4d4957 with identifier: 1980126 to the API
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Grau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ea8c4dc1-cabb-59de-934f-670d0d4d4957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 140768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8c4dc1-cabb-59de-934f-670d0d4d4957/ea8c4dc1-cabb-59de-934f-670d0d4d4957_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/4c2398b0e69848129cd60d91235fcd75/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. '
          'COOL&CONNECT Kombi, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System Aut. COOL&CONNECT '
         'Kombi, 5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980126%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [ayvens.de] INFO: Saving data for 1980126: {'created_time': 1774388894.595662, 'last_price_update_time': 1774388894.595674, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980126') HTTP/1.1" 204 0
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [ayvens.de] INFO: Found listing with ID: 1980130
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980130%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [ayvens.de] INFO: Scrape type for 1980130: 1
2026-03-24 21:48:14 [ayvens.de] INFO: Extracting data for car ID: 1980130
2026-03-24 21:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with identifier: 1980130
2026-03-24 21:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with scrape type 1
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/1.jpg not downloaded yet
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/2.jpg not downloaded yet
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e1f610>
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/10.jpg saved to cache
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/3.jpg not downloaded yet
2026-03-24 21:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/4.jpg not downloaded yet
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cada10>
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/6.jpg saved to cache
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc826b590>
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/3.jpg saved to cache
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dbab90>
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/1.jpg saved to cache
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bca850>
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fos-%252F9e02c8f00ecf4c4f9a90f56fa8540fb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/9.jpg saved to cache
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3024b217-0310-558a-b4f7-fff41e284346
2026-03-24 21:48:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3024b217-0310-558a-b4f7-fff41e284346, skipping ID generation
2026-03-24 21:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3024b217-0310-558a-b4f7-fff41e284346 with scrape type 1
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3024b217-0310-558a-b4f7-fff41e284346 sending to next pipeline
2026-03-24 21:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 3024b217-0310-558a-b4f7-fff41e284346, identifier: 1980127
2026-03-24 21:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 3024b217-0310-558a-b4f7-fff41e284346 with identifier: 1980127
2026-03-24 21:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 3024b217-0310-558a-b4f7-fff41e284346 with identifier: 1980127
2026-03-24 21:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 3024b217-0310-558a-b4f7-fff41e284346 with identifier: 1980127 to the API
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3024b217-0310-558a-b4f7-fff41e284346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 146454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3024b217-0310-558a-b4f7-fff41e284346/3024b217-0310-558a-b4f7-fff41e284346_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/os-/9e02c8f00ecf4c4f9a90f56fa8540fb7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System '
          'COOL&CONNECT Kombi, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Focus Turnier 1.5 EcoBlue Start-Stopp-System COOL&CONNECT '
         'Kombi, 5-türig, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980127%27 HTTP/1.1" 200 None
2026-03-24 21:48:15 [ayvens.de] INFO: Saving data for 1980127: {'created_time': 1774388895.750005, 'last_price_update_time': 1774388895.750015, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980127') HTTP/1.1" 204 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/5.jpg not downloaded yet
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/6.jpg not downloaded yet
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5d8d0>
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/7.jpg saved to cache
2026-03-24 21:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d52290>
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/3.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c89210>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/2.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/7.jpg not downloaded yet
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/8.jpg not downloaded yet
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/9.jpg not downloaded yet
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/10.jpg not downloaded yet
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:16 [ayvens.de] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c1a810>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/8.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a818d0>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/9.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d520d0>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/10.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3cf10>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/1.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd2cd0>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/2.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a23310>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/5.jpg saved to cache
2026-03-24 21:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a10d50>
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/6.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c71350>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/8.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9b101d0>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/10.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cf9d10>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/9.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cd3490>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/1.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d54fd0>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/3.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b65650>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/6.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc970dd10>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/5.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ff5250>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/7.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b0af10>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/2.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a41590>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/10.jpg saved to cache
2026-03-24 21:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bb53d0>
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/4.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df3b10>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/8.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3c894d0>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/6.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bca610>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/5.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b67cd0>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/9.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3db8650>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/4.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3df2790>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fob-%252F4d93354fb2c044f4bec0ee4e262926b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/7.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2
2026-03-24 21:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c13cf71-eadc-57e2-9fc3-96a624df42c2, skipping ID generation
2026-03-24 21:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with scrape type 1
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c13cf71-eadc-57e2-9fc3-96a624df42c2 sending to next pipeline
2026-03-24 21:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8c13cf71-eadc-57e2-9fc3-96a624df42c2, identifier: 1980130
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc6bd0>
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F38211768aab54b02ad443b7e9b1b83cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/2.jpg saved to cache
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5
2026-03-24 21:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5, skipping ID generation
2026-03-24 21:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with scrape type 1
2026-03-24 21:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 sending to next pipeline
2026-03-24 21:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5, identifier: 1980175
2026-03-24 21:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with identifier: 1980130
2026-03-24 21:48:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with identifier: 1980130
2026-03-24 21:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8c13cf71-eadc-57e2-9fc3-96a624df42c2 with identifier: 1980130 to the API
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Pur',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c13cf71-eadc-57e2-9fc3-96a624df42c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 112302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c13cf71-eadc-57e2-9fc3-96a624df42c2/8c13cf71-eadc-57e2-9fc3-96a624df42c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ob-/4d93354fb2c044f4bec0ee4e262926b8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-5 MAZDA CX-5 SKYACTIV-D 184 SCR AWD Aut. Sports-Line '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'MAZDA CX-5 SKYACTIV-D 184 SCR AWD Aut. Sports-Line Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980130%27 HTTP/1.1" 200 None
2026-03-24 21:48:19 [ayvens.de] INFO: Saving data for 1980130: {'created_time': 1774388899.306498, 'last_price_update_time': 1774388899.306509, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980130') HTTP/1.1" 204 0
2026-03-24 21:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with identifier: 1980175
2026-03-24 21:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with identifier: 1980175
2026-03-24 21:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 59a1cdd8-aaf1-5089-8db7-17a618e0d7a5 with identifier: 1980175 to the API
2026-03-24 21:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '59a1cdd8-aaf1-5089-8db7-17a618e0d7a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 141206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a1cdd8-aaf1-5089-8db7-17a618e0d7a5/59a1cdd8-aaf1-5089-8db7-17a618e0d7a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/38211768aab54b02ad443b7e9b1b83cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980175%27 HTTP/1.1" 200 None
2026-03-24 21:48:20 [ayvens.de] INFO: Saving data for 1980175: {'created_time': 1774388900.267521, 'last_price_update_time': 1774388900.267531, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980175') HTTP/1.1" 204 0
2026-03-24 21:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9bf98d0>
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fun-%252F38533426f5694ac39f365693a9c1ada8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/4.jpg saved to cache
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14cb2abe-d760-5280-9120-2693c248e507
2026-03-24 21:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14cb2abe-d760-5280-9120-2693c248e507, skipping ID generation
2026-03-24 21:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cb2abe-d760-5280-9120-2693c248e507 with scrape type 1
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14cb2abe-d760-5280-9120-2693c248e507 sending to next pipeline
2026-03-24 21:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 14cb2abe-d760-5280-9120-2693c248e507, identifier: 1980128
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3ca4b10>
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fd-m%252F010845fe99684572be35d44a252c35dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/3.jpg saved to cache
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8
2026-03-24 21:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, skipping ID generation
2026-03-24 21:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with scrape type 1
2026-03-24 21:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 sending to next pipeline
2026-03-24 21:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8, identifier: 1980129
2026-03-24 21:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 14cb2abe-d760-5280-9120-2693c248e507 with identifier: 1980128
2026-03-24 21:48:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 14cb2abe-d760-5280-9120-2693c248e507 with identifier: 1980128
2026-03-24 21:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 14cb2abe-d760-5280-9120-2693c248e507 with identifier: 1980128 to the API
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gray Matter',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'na',
 'id': '14cb2abe-d760-5280-9120-2693c248e507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 106506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14cb2abe-d760-5280-9120-2693c248e507/14cb2abe-d760-5280-9120-2693c248e507_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/un-/38533426f5694ac39f365693a9c1ada8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma FORD Puma 1.5 EcoBoost ST X Geschlossen, 5-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Puma 1.5 EcoBoost ST X Geschlossen, 5-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980128%27 HTTP/1.1" 200 None
2026-03-24 21:48:21 [ayvens.de] INFO: Saving data for 1980128: {'created_time': 1774388901.020315, 'last_price_update_time': 1774388901.020325, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980128') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1980129
2026-03-24 21:48:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1980129
2026-03-24 21:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 0eeff5ae-b901-5eac-a750-7d7ed9e326e8 with identifier: 1980129 to the API
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '4.4L',
 'expiration_date': '2026-03-25T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eeff5ae-b901-5eac-a750-7d7ed9e326e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40975',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eeff5ae-b901-5eac-a750-7d7ed9e326e8/0eeff5ae-b901-5eac-a750-7d7ed9e326e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/d-m/010845fe99684572be35d44a252c35dd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover LAND ROVER Range Rover 4.4 SDV8 Vogue '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover 4.4 SDV8 Vogue Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980129%27 HTTP/1.1" 200 None
2026-03-24 21:48:21 [ayvens.de] INFO: Saving data for 1980129: {'created_time': 1774388901.380091, 'last_price_update_time': 1774388901.380104, 'auction_closing_time': 1774443600.0}
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980129') HTTP/1.1" 204 0
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a92a90>
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/4.jpg saved to cache
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e0af90>
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/5.jpg saved to cache
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35ecd50>
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/8.jpg saved to cache
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a5fbd0>
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-s%252Fb8b7d62c112e4ecda7502c5dea3e0cf4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/6.jpg saved to cache
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2
2026-03-24 21:48:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2, skipping ID generation
2026-03-24 21:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with scrape type 1
2026-03-24 21:48:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 sending to next pipeline
2026-03-24 21:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2, identifier: 1980170
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2cc7bd0>
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/3.jpg saved to cache
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c3e990>
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fsb-%252Fd1f259eb3e0e4df8a38bc933ed4a9444%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/2.jpg saved to cache
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11342670-1c07-51fa-9975-7777a82b441e
2026-03-24 21:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11342670-1c07-51fa-9975-7777a82b441e, skipping ID generation
2026-03-24 21:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11342670-1c07-51fa-9975-7777a82b441e with scrape type 1
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11342670-1c07-51fa-9975-7777a82b441e sending to next pipeline
2026-03-24 21:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 11342670-1c07-51fa-9975-7777a82b441e, identifier: 1980174
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fe0e90>
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252F4d20e1f2a1ce4375be2fda5a7f76735f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/4.jpg saved to cache
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23
2026-03-24 21:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, skipping ID generation
2026-03-24 21:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with scrape type 1
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 sending to next pipeline
2026-03-24 21:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23, identifier: 1980172
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a21d10>
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpi-%252Fd5a93f8f9f4a4ebfbeb42c89f12c56d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/6.jpg saved to cache
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2
2026-03-24 21:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ad9700e-7020-541a-ab33-65d94b2c4ea2, skipping ID generation
2026-03-24 21:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with scrape type 1
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ad9700e-7020-541a-ab33-65d94b2c4ea2 sending to next pipeline
2026-03-24 21:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 7ad9700e-7020-541a-ab33-65d94b2c4ea2, identifier: 1980171
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d56b90>
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-k%252Fac46cca191064e05878c9c8deffcd881%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/4.jpg saved to cache
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c
2026-03-24 21:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c, skipping ID generation
2026-03-24 21:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with scrape type 1
2026-03-24 21:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c sending to next pipeline
2026-03-24 21:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c, identifier: 1980168
2026-03-24 21:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with identifier: 1980170
2026-03-24 21:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with identifier: 1980170
2026-03-24 21:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2 with identifier: 1980170 to the API
2026-03-24 21:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 129708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2/6bd5dc0b-2020-5593-9a07-ed5f89f9d0a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-s/b8b7d62c112e4ecda7502c5dea3e0cf4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG '
          'Line Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ GLC 300 de 4Matic 9G-TRONIC AMG Line Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980170%27 HTTP/1.1" 200 None
2026-03-24 21:48:23 [ayvens.de] INFO: Saving data for 1980170: {'created_time': 1774388903.220936, 'last_price_update_time': 1774388903.220945, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980170') HTTP/1.1" 204 0
2026-03-24 21:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1980174
2026-03-24 21:48:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1980174
2026-03-24 21:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 11342670-1c07-51fa-9975-7777a82b441e with identifier: 1980174 to the API
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': '11342670-1c07-51fa-9975-7777a82b441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Megane',
 'odometer': 109877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11342670-1c07-51fa-9975-7777a82b441e/11342670-1c07-51fa-9975-7777a82b441e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/sb-/d1f259eb3e0e4df8a38bc933ed4a9444/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Megane RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS '
          'Kombi, 5-türig, Automatik, 1-Gang',
 'transmission': 'manual',
 'trim': 'RENAULT Megane Grandtour E-TECH Plug-in 160 INTENS Kombi, 5-türig, '
         'Automatik, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980174%27 HTTP/1.1" 200 None
2026-03-24 21:48:23 [ayvens.de] INFO: Saving data for 1980174: {'created_time': 1774388903.631465, 'last_price_update_time': 1774388903.631477, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980174') HTTP/1.1" 204 0
2026-03-24 21:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1980172
2026-03-24 21:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1980172
2026-03-24 21:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 01b8707b-00ce-5b13-9e2d-bbf8727e0f23 with identifier: 1980172 to the API
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '01b8707b-00ce-5b13-9e2d-bbf8727e0f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 93012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b8707b-00ce-5b13-9e2d-bbf8727e0f23/01b8707b-00ce-5b13-9e2d-bbf8727e0f23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/4d20e1f2a1ce4375be2fda5a7f76735f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980172%27 HTTP/1.1" 200 None
2026-03-24 21:48:24 [ayvens.de] INFO: Saving data for 1980172: {'created_time': 1774388904.090236, 'last_price_update_time': 1774388904.090247, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980172') HTTP/1.1" 204 0
2026-03-24 21:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with identifier: 1980171
2026-03-24 21:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with identifier: 1980171
2026-03-24 21:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 7ad9700e-7020-541a-ab33-65d94b2c4ea2 with identifier: 1980171 to the API
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ad9700e-7020-541a-ab33-65d94b2c4ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 151734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad9700e-7020-541a-ab33-65d94b2c4ea2/7ad9700e-7020-541a-ab33-65d94b2c4ea2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pi-/d5a93f8f9f4a4ebfbeb42c89f12c56d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter MERCEDES-BENZ 317 CDI Sprinter Standard HA '
          'Hochr.Kasten, 4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'MERCEDES-BENZ 317 CDI Sprinter Standard HA Hochr.Kasten, 4-türig, '
         '6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980171%27 HTTP/1.1" 200 None
2026-03-24 21:48:24 [ayvens.de] INFO: Saving data for 1980171: {'created_time': 1774388904.470609, 'last_price_update_time': 1774388904.470619, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980171') HTTP/1.1" 204 0
2026-03-24 21:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with identifier: 1980168
2026-03-24 21:48:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with identifier: 1980168
2026-03-24 21:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c with identifier: 1980168 to the API
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse',
 'odometer': 120931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 888594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c/b1c7ff0f-0ff6-5535-81cb-bbbcd1c4634c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-k/ac46cca191064e05878c9c8deffcd881/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse MERCEDES-BENZ C 220 d T 9G-TRONIC AMG Line '
          'Kombi, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'MERCEDES-BENZ C 220 d T 9G-TRONIC AMG Line Kombi, 5-türig, '
         'Automatik, 9-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980168%27 HTTP/1.1" 200 None
2026-03-24 21:48:24 [ayvens.de] INFO: Saving data for 1980168: {'created_time': 1774388904.858417, 'last_price_update_time': 1774388904.858427, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980168') HTTP/1.1" 204 0
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3aa2510>
2026-03-24 21:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/10.jpg saved to cache
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c85550>
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fbm-%252Fe7f9a029396c4b14964ffd806b6bc043%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/5.jpg saved to cache
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82a13136-ea01-53ae-a994-b295f4999f66
2026-03-24 21:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82a13136-ea01-53ae-a994-b295f4999f66, skipping ID generation
2026-03-24 21:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a13136-ea01-53ae-a994-b295f4999f66 with scrape type 1
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82a13136-ea01-53ae-a994-b295f4999f66 sending to next pipeline
2026-03-24 21:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 82a13136-ea01-53ae-a994-b295f4999f66, identifier: 1980162
2026-03-24 21:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 82a13136-ea01-53ae-a994-b295f4999f66 with identifier: 1980162
2026-03-24 21:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 82a13136-ea01-53ae-a994-b295f4999f66 with identifier: 1980162
2026-03-24 21:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 82a13136-ea01-53ae-a994-b295f4999f66 with identifier: 1980162 to the API
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '82a13136-ea01-53ae-a994-b295f4999f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'EV6',
 'odometer': 50419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a13136-ea01-53ae-a994-b295f4999f66/82a13136-ea01-53ae-a994-b295f4999f66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/bm-/e7f9a029396c4b14964ffd806b6bc043/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 KIA EV6 77,4-kWh AWD GT-line Limousine, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'KIA EV6 77,4-kWh AWD GT-line Limousine, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980162%27 HTTP/1.1" 200 None
2026-03-24 21:48:25 [ayvens.de] INFO: Saving data for 1980162: {'created_time': 1774388905.575512, 'last_price_update_time': 1774388905.575523, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980162') HTTP/1.1" 204 0
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3cc5b50>
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/9.jpg saved to cache
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c11b50>
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/9.jpg saved to cache
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3a830d0>
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fwil%252F859691a996b54be39b56695e4136e2ae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/9.jpg saved to cache
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be
2026-03-24 21:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be, skipping ID generation
2026-03-24 21:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with scrape type 1
2026-03-24 21:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be sending to next pipeline
2026-03-24 21:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be, identifier: 1980164
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3abced0>
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/8.jpg saved to cache
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc8215810>
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fb-a%252F6906a096187c407895c94b4d5bde0d48%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/8.jpg saved to cache
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a686785d-d8cf-5939-85d1-86b28d7dc64f
2026-03-24 21:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a686785d-d8cf-5939-85d1-86b28d7dc64f, skipping ID generation
2026-03-24 21:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a686785d-d8cf-5939-85d1-86b28d7dc64f with scrape type 1
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a686785d-d8cf-5939-85d1-86b28d7dc64f sending to next pipeline
2026-03-24 21:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: a686785d-d8cf-5939-85d1-86b28d7dc64f, identifier: 1980167
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc970ded0>
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fcha%252Fed44d54eea48400dbf3db912d2138c6f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/7.jpg saved to cache
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcb3a863-1393-5f44-bc3b-27a6bfe864db
2026-03-24 21:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcb3a863-1393-5f44-bc3b-27a6bfe864db, skipping ID generation
2026-03-24 21:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb3a863-1393-5f44-bc3b-27a6bfe864db with scrape type 1
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcb3a863-1393-5f44-bc3b-27a6bfe864db sending to next pipeline
2026-03-24 21:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: bcb3a863-1393-5f44-bc3b-27a6bfe864db, identifier: 1980166
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3dc9b90>
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35061944bb6943008380c00843332110%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/10.jpg saved to cache
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc2befc0-23ac-597b-a8d1-686a2d8489a8
2026-03-24 21:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc2befc0-23ac-597b-a8d1-686a2d8489a8, skipping ID generation
2026-03-24 21:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2befc0-23ac-597b-a8d1-686a2d8489a8 with scrape type 1
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc2befc0-23ac-597b-a8d1-686a2d8489a8 sending to next pipeline
2026-03-24 21:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: fc2befc0-23ac-597b-a8d1-686a2d8489a8, identifier: 1980152
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3e094d0>
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fpf-%252F5f4d50fa20ab407da17641118e6f13a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/10.jpg saved to cache
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb
2026-03-24 21:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb, skipping ID generation
2026-03-24 21:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with scrape type 1
2026-03-24 21:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef60a3d2-e1f4-5a02-85cf-c46dd99646bb sending to next pipeline
2026-03-24 21:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb, identifier: 1980159
2026-03-24 21:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with identifier: 1980164
2026-03-24 21:48:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with identifier: 1980164
2026-03-24 21:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be with identifier: 1980164 to the API
2026-03-24 21:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gr',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'Sportage',
 'odometer': 103829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be/8a9fd6f3-8b17-57f6-bdbf-dd0d7493d9be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/wil/859691a996b54be39b56695e4136e2ae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage KIA Sportage 1,6 CRDI AWD Eco-Dynamics+ (48V M-H) DCT '
          'Spirit Geschlossen, 5-türig, Automatik, 7-Gang',
 'transmission': 'automatic',
 'trim': 'KIA Sportage 1,6 CRDI AWD Eco-Dynamics+ (48V M-H) DCT Spirit '
         'Geschlossen, 5-türig, Automatik, 7-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980164%27 HTTP/1.1" 200 None
2026-03-24 21:48:27 [ayvens.de] INFO: Saving data for 1980164: {'created_time': 1774388907.147459, 'last_price_update_time': 1774388907.147471, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980164') HTTP/1.1" 204 0
2026-03-24 21:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: a686785d-d8cf-5939-85d1-86b28d7dc64f with identifier: 1980167
2026-03-24 21:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: a686785d-d8cf-5939-85d1-86b28d7dc64f with identifier: 1980167
2026-03-24 21:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: a686785d-d8cf-5939-85d1-86b28d7dc64f with identifier: 1980167 to the API
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a686785d-d8cf-5939-85d1-86b28d7dc64f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'Range Rover Evoque',
 'odometer': 46342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a686785d-d8cf-5939-85d1-86b28d7dc64f/a686785d-d8cf-5939-85d1-86b28d7dc64f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/b-a/6906a096187c407895c94b4d5bde0d48/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER Range Rover Evoque LAND ROVER Range Rover Evoque D165 '
          'R-Dynamic SE Geschlossen, 5-türig, Automatik, 9-Gang',
 'transmission': 'automatic',
 'trim': 'LAND ROVER Range Rover Evoque D165 R-Dynamic SE Geschlossen, '
         '5-türig, Automatik, 9-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980167%27 HTTP/1.1" 200 None
2026-03-24 21:48:27 [ayvens.de] INFO: Saving data for 1980167: {'created_time': 1774388907.512556, 'last_price_update_time': 1774388907.512566, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980167') HTTP/1.1" 204 0
2026-03-24 21:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: bcb3a863-1393-5f44-bc3b-27a6bfe864db with identifier: 1980166
2026-03-24 21:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: bcb3a863-1393-5f44-bc3b-27a6bfe864db with identifier: 1980166
2026-03-24 21:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: bcb3a863-1393-5f44-bc3b-27a6bfe864db with identifier: 1980166 to the API
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Carrarawei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'bcb3a863-1393-5f44-bc3b-27a6bfe864db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCeed',
 'odometer': 65272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb3a863-1393-5f44-bc3b-27a6bfe864db/bcb3a863-1393-5f44-bc3b-27a6bfe864db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/cha/ed44d54eea48400dbf3db912d2138c6f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCeed KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Vision '
          'Geschlossen, 5-türig, Automatik, 6-Gang',
 'transmission': 'automatic',
 'trim': 'KIA XCeed 1.6 GDI DCT6 OPF Plug-in-Hybrid Vision Geschlossen, '
         '5-türig, Automatik, 6-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980166%27 HTTP/1.1" 200 None
2026-03-24 21:48:27 [ayvens.de] INFO: Saving data for 1980166: {'created_time': 1774388907.876016, 'last_price_update_time': 1774388907.876027, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980166') HTTP/1.1" 204 0
2026-03-24 21:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: fc2befc0-23ac-597b-a8d1-686a2d8489a8 with identifier: 1980152
2026-03-24 21:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: fc2befc0-23ac-597b-a8d1-686a2d8489a8 with identifier: 1980152
2026-03-24 21:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: fc2befc0-23ac-597b-a8d1-686a2d8489a8 with identifier: 1980152 to the API
2026-03-24 21:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'fc2befc0-23ac-597b-a8d1-686a2d8489a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'I-Pace',
 'odometer': 49024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2befc0-23ac-597b-a8d1-686a2d8489a8/fc2befc0-23ac-597b-a8d1-686a2d8489a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35061944bb6943008380c00843332110/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR I-Pace JAGUAR I-Pace EV400 AWD S Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'JAGUAR I-Pace EV400 AWD S Geschlossen, 5-türig, Direktantrieb, '
         '1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980152%27 HTTP/1.1" 200 None
2026-03-24 21:48:28 [ayvens.de] INFO: Saving data for 1980152: {'created_time': 1774388908.237553, 'last_price_update_time': 1774388908.237565, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980152') HTTP/1.1" 204 0
2026-03-24 21:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1980159
2026-03-24 21:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1980159
2026-03-24 21:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: ef60a3d2-e1f4-5a02-85cf-c46dd99646bb with identifier: 1980159 to the API
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef60a3d2-e1f4-5a02-85cf-c46dd99646bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Santa Fe',
 'odometer': 274386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef60a3d2-e1f4-5a02-85cf-c46dd99646bb/ef60a3d2-e1f4-5a02-85cf-c46dd99646bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/pf-/5f4d50fa20ab407da17641118e6f13a6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Santa Fe HYUNDAI Santa Fe 2.2 CRDi 4WD Automatik Premium '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Santa Fe 2.2 CRDi 4WD Automatik Premium Geschlossen, '
         '5-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980159%27 HTTP/1.1" 200 None
2026-03-24 21:48:28 [ayvens.de] INFO: Saving data for 1980159: {'created_time': 1774388908.605054, 'last_price_update_time': 1774388908.605064, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980159') HTTP/1.1" 204 0
2026-03-24 21:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2ccfc10>
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ff-c%252Fcd2ddc04f9e2476fab82babbb47dd513%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/1.jpg saved to cache
2026-03-24 21:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5649e09f-005e-5163-abe0-84bf79057a0c
2026-03-24 21:48:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5649e09f-005e-5163-abe0-84bf79057a0c, skipping ID generation
2026-03-24 21:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5649e09f-005e-5163-abe0-84bf79057a0c with scrape type 1
2026-03-24 21:48:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5649e09f-005e-5163-abe0-84bf79057a0c sending to next pipeline
2026-03-24 21:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 5649e09f-005e-5163-abe0-84bf79057a0c, identifier: 1980153
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd2410>
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/5.jpg saved to cache
2026-03-24 21:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1980153
2026-03-24 21:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1980153
2026-03-24 21:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 5649e09f-005e-5163-abe0-84bf79057a0c with identifier: 1980153 to the API
2026-03-24 21:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'na',
 'id': '5649e09f-005e-5163-abe0-84bf79057a0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'XE',
 'odometer': 83743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5649e09f-005e-5163-abe0-84bf79057a0c/5649e09f-005e-5163-abe0-84bf79057a0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/f-c/cd2ddc04f9e2476fab82babbb47dd513/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR XE JAGUAR XE P250 Aut. R-Dynamic S Limousine, 4-türig, '
          'Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'JAGUAR XE P250 Aut. R-Dynamic S Limousine, 4-türig, Automatik, '
         '8-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980153%27 HTTP/1.1" 200 None
2026-03-24 21:48:29 [ayvens.de] INFO: Saving data for 1980153: {'created_time': 1774388909.237698, 'last_price_update_time': 1774388909.237708, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980153') HTTP/1.1" 204 0
2026-03-24 21:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b2a890>
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe68c4283ef0d4b00aa7731dcadcb39a2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/9.jpg saved to cache
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26eed75b-d158-5e97-8d4a-6d0c12f883df
2026-03-24 21:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26eed75b-d158-5e97-8d4a-6d0c12f883df, skipping ID generation
2026-03-24 21:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26eed75b-d158-5e97-8d4a-6d0c12f883df with scrape type 1
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26eed75b-d158-5e97-8d4a-6d0c12f883df sending to next pipeline
2026-03-24 21:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 26eed75b-d158-5e97-8d4a-6d0c12f883df, identifier: 1980161
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3fae710>
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/3.jpg saved to cache
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9bfae50>
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhd-%252Fe36a5eadb25b44578355fe88d95f0879%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/2.jpg saved to cache
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72becd66-d34a-5c15-8560-322b276164ff
2026-03-24 21:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72becd66-d34a-5c15-8560-322b276164ff, skipping ID generation
2026-03-24 21:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72becd66-d34a-5c15-8560-322b276164ff with scrape type 1
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72becd66-d34a-5c15-8560-322b276164ff sending to next pipeline
2026-03-24 21:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 72becd66-d34a-5c15-8560-322b276164ff, identifier: 1980151
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9bf9910>
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fe4eb325c14994990ace1799941f64071%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/6.jpg saved to cache
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1cc7fe1-554c-52da-9010-581720aaa05f
2026-03-24 21:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1cc7fe1-554c-52da-9010-581720aaa05f, skipping ID generation
2026-03-24 21:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1cc7fe1-554c-52da-9010-581720aaa05f with scrape type 1
2026-03-24 21:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1cc7fe1-554c-52da-9010-581720aaa05f sending to next pipeline
2026-03-24 21:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: b1cc7fe1-554c-52da-9010-581720aaa05f, identifier: 1980147
2026-03-24 21:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 26eed75b-d158-5e97-8d4a-6d0c12f883df with identifier: 1980161
2026-03-24 21:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 26eed75b-d158-5e97-8d4a-6d0c12f883df with identifier: 1980161
2026-03-24 21:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 26eed75b-d158-5e97-8d4a-6d0c12f883df with identifier: 1980161 to the API
2026-03-24 21:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Rot',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': '26eed75b-d158-5e97-8d4a-6d0c12f883df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-Niro',
 'odometer': 71523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26eed75b-d158-5e97-8d4a-6d0c12f883df/26eed75b-d158-5e97-8d4a-6d0c12f883df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e68c4283ef0d4b00aa7731dcadcb39a2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-Niro KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, '
          '1-Gang',
 'transmission': 'manual',
 'trim': 'KIA e-Niro Vision Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980161%27 HTTP/1.1" 200 None
2026-03-24 21:48:30 [ayvens.de] INFO: Saving data for 1980161: {'created_time': 1774388910.245994, 'last_price_update_time': 1774388910.246005, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980161') HTTP/1.1" 204 0
2026-03-24 21:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1980151
2026-03-24 21:48:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1980151
2026-03-24 21:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 72becd66-d34a-5c15-8560-322b276164ff with identifier: 1980151 to the API
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 6,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '72becd66-d34a-5c15-8560-322b276164ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 151892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72becd66-d34a-5c15-8560-322b276164ff/72becd66-d34a-5c15-8560-322b276164ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hd-/e36a5eadb25b44578355fe88d95f0879/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON HYUNDAI Tucson blue 2.0 CRDi 4WD Aut. N Line '
          'Geschlossen, 5-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'HYUNDAI Tucson blue 2.0 CRDi 4WD Aut. N Line Geschlossen, 5-türig, '
         'Automatik, 8-Gang',
 'vin': None,
 'year': 2020}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980151%27 HTTP/1.1" 200 None
2026-03-24 21:48:30 [ayvens.de] INFO: Saving data for 1980151: {'created_time': 1774388910.61724, 'last_price_update_time': 1774388910.617249, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980151') HTTP/1.1" 204 0
2026-03-24 21:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: b1cc7fe1-554c-52da-9010-581720aaa05f with identifier: 1980147
2026-03-24 21:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: b1cc7fe1-554c-52da-9010-581720aaa05f with identifier: 1980147
2026-03-24 21:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: b1cc7fe1-554c-52da-9010-581720aaa05f with identifier: 1980147 to the API
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'electric',
 'id': 'b1cc7fe1-554c-52da-9010-581720aaa05f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA EV',
 'odometer': 59185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1cc7fe1-554c-52da-9010-581720aaa05f/b1cc7fe1-554c-52da-9010-581720aaa05f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/e4eb325c14994990ace1799941f64071/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA EV HYUNDAI Kona EV Style Geschlossen, 5-türig, '
          'Direktantrieb, 1-Gang',
 'transmission': 'manual',
 'trim': 'HYUNDAI Kona EV Style Geschlossen, 5-türig, Direktantrieb, 1-Gang',
 'vin': None,
 'year': 2021}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980147%27 HTTP/1.1" 200 None
2026-03-24 21:48:30 [ayvens.de] INFO: Saving data for 1980147: {'created_time': 1774388910.964139, 'last_price_update_time': 1774388910.964149, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980147') HTTP/1.1" 204 0
2026-03-24 21:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7f910>
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/9.jpg saved to cache
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc9a06b50>
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fh-c%252F595d57b7b483449ca992788b59aa36a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/8.jpg saved to cache
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb001a3e-3d95-5461-b1a4-4aefd6369987
2026-03-24 21:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb001a3e-3d95-5461-b1a4-4aefd6369987, skipping ID generation
2026-03-24 21:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb001a3e-3d95-5461-b1a4-4aefd6369987 with scrape type 1
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb001a3e-3d95-5461-b1a4-4aefd6369987 sending to next pipeline
2026-03-24 21:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: eb001a3e-3d95-5461-b1a4-4aefd6369987, identifier: 1980145
2026-03-24 21:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: eb001a3e-3d95-5461-b1a4-4aefd6369987 with identifier: 1980145
2026-03-24 21:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: eb001a3e-3d95-5461-b1a4-4aefd6369987 with identifier: 1980145
2026-03-24 21:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: eb001a3e-3d95-5461-b1a4-4aefd6369987 with identifier: 1980145 to the API
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb001a3e-3d95-5461-b1a4-4aefd6369987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit Connect',
 'odometer': 60670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb001a3e-3d95-5461-b1a4-4aefd6369987/eb001a3e-3d95-5461-b1a4-4aefd6369987_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/h-c/595d57b7b483449ca992788b59aa36a6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD Transit Connect FORD Transit Connect 230 L2 Trend Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit Connect 230 L2 Trend Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980145%27 HTTP/1.1" 200 None
2026-03-24 21:48:31 [ayvens.de] INFO: Saving data for 1980145: {'created_time': 1774388911.728001, 'last_price_update_time': 1774388911.728012, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980145') HTTP/1.1" 204 0
2026-03-24 21:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d56350>
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fhh-%252F3ca7cf455f464cc98509871ae4eb60fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/7.jpg saved to cache
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59a6003-66df-5951-9d5c-6ccb97fe6914
2026-03-24 21:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59a6003-66df-5951-9d5c-6ccb97fe6914, skipping ID generation
2026-03-24 21:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a6003-66df-5951-9d5c-6ccb97fe6914 with scrape type 1
2026-03-24 21:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59a6003-66df-5951-9d5c-6ccb97fe6914 sending to next pipeline
2026-03-24 21:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: f59a6003-66df-5951-9d5c-6ccb97fe6914, identifier: 1980144
2026-03-24 21:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1980144
2026-03-24 21:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1980144
2026-03-24 21:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: f59a6003-66df-5951-9d5c-6ccb97fe6914 with identifier: 1980144 to the API
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f59a6003-66df-5951-9d5c-6ccb97fe6914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Transit',
 'odometer': 28359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59a6003-66df-5951-9d5c-6ccb97fe6914/f59a6003-66df-5951-9d5c-6ccb97fe6914_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/hh-/3ca7cf455f464cc98509871ae4eb60fd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD Transit FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, '
          '4-türig, 6-Gang',
 'transmission': 'manual',
 'trim': 'FORD Transit 310 L3H3 Lkw VA Basis Hochr.Kasten, 4-türig, 6-Gang',
 'vin': None,
 'year': 2024}
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980144%27 HTTP/1.1" 200 None
2026-03-24 21:48:32 [ayvens.de] INFO: Saving data for 1980144: {'created_time': 1774388912.254419, 'last_price_update_time': 1774388912.254429, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980144') HTTP/1.1" 204 0
2026-03-24 21:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2c7c310>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/9.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc2caf410>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/6.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35f7490>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/5.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3bd7190>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/2.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc35efa50>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/3.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3d0bf90>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fka-%252Fda7f4147c38e49a49c0dd1528927c32b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/4.jpg saved to cache
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item befb7e0f-7246-555b-abff-47f570424eb5
2026-03-24 21:48:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: befb7e0f-7246-555b-abff-47f570424eb5, skipping ID generation
2026-03-24 21:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befb7e0f-7246-555b-abff-47f570424eb5 with scrape type 1
2026-03-24 21:48:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item befb7e0f-7246-555b-abff-47f570424eb5 sending to next pipeline
2026-03-24 21:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: befb7e0f-7246-555b-abff-47f570424eb5, identifier: 1980138
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc99a8cd0>
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fm-v%252F71571f0a4e6144c8991d5f8d831ba86d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/6.jpg saved to cache
2026-03-24 21:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc
2026-03-24 21:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc, skipping ID generation
2026-03-24 21:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with scrape type 1
2026-03-24 21:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc sending to next pipeline
2026-03-24 21:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc, identifier: 1980133
2026-03-24 21:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: befb7e0f-7246-555b-abff-47f570424eb5 with identifier: 1980138
2026-03-24 21:48:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 21:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: befb7e0f-7246-555b-abff-47f570424eb5 with identifier: 1980138
2026-03-24 21:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: befb7e0f-7246-555b-abff-47f570424eb5 with identifier: 1980138 to the API
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Lackierung',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'befb7e0f-7246-555b-abff-47f570424eb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Kuga',
 'odometer': 86084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befb7e0f-7246-555b-abff-47f570424eb5/befb7e0f-7246-555b-abff-47f570424eb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ka-/da7f4147c38e49a49c0dd1528927c32b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Kuga FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Kuga 2.5 Duratec PHEV VIGNALE Geschlossen, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2022}
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980138%27 HTTP/1.1" 200 None
2026-03-24 21:48:33 [ayvens.de] INFO: Saving data for 1980138: {'created_time': 1774388913.475784, 'last_price_update_time': 1774388913.475794, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980138') HTTP/1.1" 204 0
2026-03-24 21:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with identifier: 1980133
2026-03-24 21:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with identifier: 1980133
2026-03-24 21:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc with identifier: 1980133 to the API
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Wei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd58d186e-d7ad-58e1-b488-d7bdbf3bb5fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Galaxy',
 'odometer': 55478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc/d58d186e-d7ad-58e1-b488-d7bdbf3bb5fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/m-v/71571f0a4e6144c8991d5f8d831ba86d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD Galaxy FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, '
          'Automatik, 1-Gang',
 'transmission': 'automatic',
 'trim': 'FORD Galaxy 2.5 Duratec FHEV TITANIUM Kombi, 5-türig, Automatik, '
         '1-Gang',
 'vin': None,
 'year': 2023}
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980133%27 HTTP/1.1" 200 None
2026-03-24 21:48:33 [ayvens.de] INFO: Saving data for 1980133: {'created_time': 1774388913.868178, 'last_price_update_time': 1774388913.868189, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980133') HTTP/1.1" 204 0
2026-03-24 21:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3feb550>
2026-03-24 21:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/8.jpg saved to cache
2026-03-24 21:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 21:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 21:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6dc3b41110>
2026-03-24 21:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 21:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.de',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fe-i%252Fdf9b3c5124b546968192334fda528f8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 21:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/7.jpg saved to cache
2026-03-24 21:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 037178ef-93a0-56df-8617-44612396491d
2026-03-24 21:48:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 037178ef-93a0-56df-8617-44612396491d, skipping ID generation
2026-03-24 21:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037178ef-93a0-56df-8617-44612396491d with scrape type 1
2026-03-24 21:48:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 037178ef-93a0-56df-8617-44612396491d sending to next pipeline
2026-03-24 21:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.de, Processed item id: 037178ef-93a0-56df-8617-44612396491d, identifier: 1980132
2026-03-24 21:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.de, Translating item: 037178ef-93a0-56df-8617-44612396491d with identifier: 1980132
2026-03-24 21:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.de, Applying rules to item: 037178ef-93a0-56df-8617-44612396491d with identifier: 1980132
2026-03-24 21:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.de, Posting item: 037178ef-93a0-56df-8617-44612396491d with identifier: 1980132 to the API
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 21:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T14:00:00Z',
 'fuel_type': 'diesel',
 'id': '037178ef-93a0-56df-8617-44612396491d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40976',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5er',
 'odometer': 132448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_037178ef-93a0-56df-8617-44612396491d/037178ef-93a0-56df-8617-44612396491d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/e-i/df9b3c5124b546968192334fda528f8a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er BMW 520d Aut. Limousine, 4-türig, Automatik, 8-Gang',
 'transmission': 'automatic',
 'trim': 'BMW 520d Aut. Limousine, 4-türig, Automatik, 8-Gang',
 'vin': None,
 'year': 2018}
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20RowKey%20eq%20%271980132%27 HTTP/1.1" 200 None
2026-03-24 21:48:34 [ayvens.de] INFO: Saving data for 1980132: {'created_time': 1774388914.589747, 'last_price_update_time': 1774388914.589757, 'auction_closing_time': 1774447200.0}
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.de',RowKey='1980132') HTTP/1.1" 204 0
2026-03-24 21:48:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-24 21:48:34 [ayvens.de] INFO: ayvens.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 6, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.de%27%20and%20last_price_update_time%20lt%201773956914 HTTP/1.1" 200 None
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971771') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971772') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971773') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971774') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971775') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971828') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971829') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971830') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971831') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971832') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971833') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971834') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971835') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971836') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971837') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971838') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971839') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971840') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971841') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971842') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971843') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971844') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971845') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971846') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971847') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971848') HTTP/1.1" 204 0
2026-03-24 21:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971849') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971850') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971851') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971852') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971853') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971854') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971855') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971856') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971857') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971858') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971859') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971860') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971861') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971862') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971863') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971864') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971865') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971866') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971867') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971868') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971869') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971870') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971871') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971872') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971873') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971874') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971875') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971876') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971877') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971878') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971879') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971880') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971881') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971882') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971883') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971884') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971885') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971886') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971887') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971888') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971889') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971890') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971891') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971892') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971893') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971894') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971895') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971896') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971897') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971898') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971899') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971900') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971901') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971902') HTTP/1.1" 204 0
2026-03-24 21:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.de',RowKey='1971903') HTTP/1.1" 204 0
2026-03-24 21:48:35 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (110 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.de/task_43_2026-03-24T21_45_00.jl
2026-03-24 21:48:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 513383,
 'downloader/request_count': 1104,
 'downloader/request_method_count/GET': 1101,
 'downloader/request_method_count/POST': 3,
 'downloader/response_bytes': 789014913,
 'downloader/response_count': 1104,
 'downloader/response_status_count/200': 1104,
 'elapsed_time_seconds': 209.15865,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 24, 21, 48, 35, 546363, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 110,
 'log_count/DEBUG': 9213,
 'log_count/INFO': 9241,
 'memusage/max': 197586944,
 'memusage/startup': 149979136,
 'photo_download_count': 1100,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 130,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 125,
 'playwright/request_count/method/POST': 5,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 25,
 'playwright/request_count/resource_type/script': 79,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 6,
 'playwright/response_count': 112,
 'playwright/response_count/method/GET': 109,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 10,
 'playwright/response_count/resource_type/script': 79,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 3,
 'request_depth_max': 3,
 'response_received_count': 4,
 'scheduler/dequeued': 1104,
 'scheduler/dequeued/memory': 1104,
 'scheduler/enqueued': 1104,
 'scheduler/enqueued/memory': 1104,
 'scrape_type/new': 110,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 3,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.821582659458121,
 'scrapy-zyte-api/mean_response_seconds': 2.8670978266745806,
 'scrapy-zyte-api/processed': 3,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
 'scrapy-zyte-api/request_args/httpRequestBody': 3,
 'scrapy-zyte-api/request_args/httpRequestMethod': 3,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/url': 3,
 'scrapy-zyte-api/status_codes/200': 3,
 'scrapy-zyte-api/success': 3,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 24, 21, 45, 6, 387713, tzinfo=datetime.timezone.utc)}
2026-03-24 21:48:35 [scrapy.core.engine] INFO: Spider closed (finished)